-- Logs begin at Fri 2022-05-13 12:12:52 UTC, end at Fri 2022-05-13 13:14:54 UTC. -- May 13 12:45:16.757711 dv-cinder-841644-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 12:45:16.766301 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 12:45:16 2022] *** May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: nodename: dv-cinder-841644-1-iscsi May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: machine: x86_64 May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: clock source: unix May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: pcre jit disabled May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: detected number of CPU cores: 4 May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: current working directory: / May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: detected binary path: /usr/bin/uwsgi-core May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: your processes number limit is 47680 May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: your memory page size is 4096 bytes May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: detected max file descriptor number: 2048 May 13 12:45:16.768380 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: lock engine: pthread robust mutexes May 13 12:45:16.769788 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: thunder lock: enabled May 13 12:45:16.769788 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 12:45:16.769788 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 12:45:16.813882 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: Python main interpreter initialized at 0x55ddbe8879c0 May 13 12:45:16.813882 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: python threads support enabled May 13 12:45:16.813882 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: your server socket listen backlog is limited to 100 connections May 13 12:45:16.813882 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: your mercy for graceful operations on workers is 90 seconds May 13 12:45:16.814199 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: mapped 403077 bytes (393 KB) for 2 cores May 13 12:45:16.814298 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: *** Operational MODE: preforking *** May 13 12:45:16.814558 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: *** uWSGI is running in multiple interpreter mode *** May 13 12:45:16.814558 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: spawned uWSGI master process (pid: 109060) May 13 12:45:16.814752 dv-cinder-841644-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 12:45:16.818586 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: spawned uWSGI worker 1 (pid: 109061, cores: 1) May 13 12:45:16.818586 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: spawned uWSGI worker 2 (pid: 109062, cores: 1) May 13 12:45:16.818586 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 12:45:18.016356 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 12:45:18.023756 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 12:45:18.755915 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:45:18.755915 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: from cryptography.utils import int_from_bytes May 13 12:45:18.756243 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:45:18.756243 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: from cryptography.utils import int_from_bytes May 13 12:45:18.760354 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:45:18.760354 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: from cryptography.utils import int_from_bytes May 13 12:45:18.760687 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:45:18.760687 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: from cryptography.utils import int_from_bytes May 13 12:45:21.375160 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 12:45:21.375683 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 12:45:21.375843 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 12:45:21.376218 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 12:45:21.376475 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 12:45:21.376795 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 12:45:21.377194 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.377277 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 12:45:21.377366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.377527 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.377628 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 12:45:21.377856 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.377945 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 12:45:21.378195 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.378296 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 12:45:21.378516 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.378603 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.378845 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.378932 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.379171 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.379266 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.379511 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.379604 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.379779 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.379865 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.380102 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.380198 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.380437 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841644-1-iscsi {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.380536 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.380764 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.380860 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.381103 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.381195 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.381369 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.381454 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.381689 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.381775 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.382022 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841644-1-iscsi {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.382111 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.382358 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.382444 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.382669 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.382762 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.382983 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.383173 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384370 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384370 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384600 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384600 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384758 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384831 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384896 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.384969 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385075 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385166 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385240 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385304 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385378 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385518 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385652 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385807 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.385992 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.386140 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.386311 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.386456 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.386627 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.386859 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841644-1-iscsi {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.386954 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.387184 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.387489 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.388136 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.388225 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.388543 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.388735 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.388940 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841644-1-iscsi {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.389180 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.389291 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.389615 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.389713 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.389937 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.390077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.390359 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.390514 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.390684 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.390969 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.391084 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.391405 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.391630 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.391742 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.391823 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.392039 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.392177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.392380 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.392597 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.392693 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.393045 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.393147 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.393376 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.393531 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.393687 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.393970 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.394056 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.394305 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.394388 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.394900 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.395116 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.395203 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.395438 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.395530 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.395751 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.395839 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.396066 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.396182 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.396396 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.396619 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.396726 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.397085 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.397177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.397349 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.397580 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.397678 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.397917 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.398019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.398243 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.398384 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.398558 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.398698 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.398872 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.399031 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.399187 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.399366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.399503 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.399688 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.399817 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.400007 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.400132 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.400327 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.400446 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.400647 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.400756 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.400967 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.401122 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.401320 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.401417 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.401641 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.401728 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.401959 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.402046 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.402287 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.402373 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.402612 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.402728 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.402980 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.403074 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.403317 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.403474 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.403700 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.403834 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.403976 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.404203 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.404296 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.404469 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.404605 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.404786 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.404940 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.405202 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.405342 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.405487 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.405627 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.405798 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.405934 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.406096 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.406241 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.406425 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.406569 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.406742 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.406879 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.407013 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.407146 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.407313 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.407456 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.407627 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.407763 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.407952 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.408088 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.408250 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.408387 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.408530 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.408663 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.408817 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.408961 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.409155 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.409246 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.409483 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.409580 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.409791 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.409885 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.410102 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.410193 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.410410 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.410496 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.410716 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.410810 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.411025 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.411130 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.411335 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.411421 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.411642 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.411737 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.411950 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.412034 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.412258 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.412342 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.412566 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.412660 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.412879 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.412964 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.413219 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.413328 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.413523 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.413610 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.413847 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.413939 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.414157 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.414251 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.414468 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.414615 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.414761 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.414896 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.415076 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.415289 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.415438 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.415581 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.415718 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.415850 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.415982 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.416129 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.416271 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.416404 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.416577 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.416714 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.416894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.417043 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.417230 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.417363 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.417542 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.417689 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.417854 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.417995 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.418167 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.418303 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.418478 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.418672 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.418978 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.419119 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.419268 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.419402 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.419534 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.419675 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.419809 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.419945 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.420104 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.420238 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.420414 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.420552 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.420719 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.420875 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.421069 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.421208 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.421372 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.421463 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.421684 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.421783 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.421994 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.422080 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.422298 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.422382 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.422622 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.422717 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.422951 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.423039 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.423267 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.423353 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.423580 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.423674 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.423892 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.423994 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.424220 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:45:21.424320 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.424557 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.424699 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.424879 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.425044 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.425225 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.425311 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.425549 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.425640 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.425882 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.426006 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.426201 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.426287 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.426519 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.426624 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.426835 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.426925 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.427155 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.427249 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.427479 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.427565 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.427794 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.427879 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.428110 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.428429 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.428544 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.428751 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.428835 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.429088 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.429196 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.429414 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.429501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.429732 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.429817 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.430054 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.430150 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.430368 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.430454 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.430682 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.430767 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.431006 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.431102 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.431350 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.431445 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.431677 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.431762 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.431991 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.432085 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.432312 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.432402 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.432629 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.432722 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.432946 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.433063 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.433300 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.433386 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.433634 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.433720 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.433950 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.434046 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.434777 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.434877 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.435095 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.435426 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.435521 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.435752 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.435838 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.436071 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.436157 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.436389 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.436483 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.436704 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.436799 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.437043 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.437147 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.437366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.437454 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.437686 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.437773 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.438002 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.438104 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.438326 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.438415 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.438646 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.438741 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.438963 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.439049 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.439277 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.439363 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.439591 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.439677 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.439904 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.439991 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.440217 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.440304 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.440527 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.440664 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.440835 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.440931 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.441169 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.441257 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.441483 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.441623 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.441804 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.441949 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.442118 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.442303 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.442455 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.442591 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.442744 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.442891 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.443036 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.443185 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.443347 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.443479 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.443660 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.443805 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.443978 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.444109 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.444290 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.444432 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.444599 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.444765 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.444960 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.445170 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.445319 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.445454 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.445602 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.445737 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.445871 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.446016 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.446153 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.446300 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.446446 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.446581 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.446746 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.446884 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.447074 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.447236 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.447382 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.447515 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.447659 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.447792 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.447980 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.448131 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.448280 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.448415 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.448598 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.448735 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.448915 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.449097 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.449260 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.449393 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.449590 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.449728 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.450513 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.450682 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.450852 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.451098 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.451231 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.451445 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.451592 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.451765 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.451909 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.452077 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.452209 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.452397 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.452534 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.452711 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.452853 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.453031 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.453165 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.453348 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.453501 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.453660 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.453797 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.453968 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.454111 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.454276 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.454422 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.454585 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.454721 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.454891 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.455051 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.455183 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.455326 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.455498 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.455642 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.455809 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.455956 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.456114 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.456258 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.456424 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.456565 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.456734 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.456873 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.457048 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.457180 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.457361 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.457495 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.457673 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.457816 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.458022 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.458156 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.458335 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.458468 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.458685 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.458818 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.458999 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.459130 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.459322 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.459463 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.459640 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.459773 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.459956 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.460087 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.460268 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.460406 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.460581 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.460722 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.460900 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.461074 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.461242 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.461387 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.461561 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.461709 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.461875 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.462021 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.462192 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.462334 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.462509 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.462653 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.462824 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.462960 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.463139 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.463278 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.463454 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.463598 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.463779 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.463916 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.464091 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.464228 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.464411 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.464556 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.464737 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.464872 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.465080 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.465219 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.465422 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.465526 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.465752 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.465842 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.466074 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.466192 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.466392 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.466492 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.466707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.466793 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.467021 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.467114 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.467333 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.467419 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.467646 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.467730 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.467955 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.468049 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.468271 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.468359 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.468585 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.468675 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.468896 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.469009 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.469230 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.469314 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.469551 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.469647 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.469874 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.469972 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.470183 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.470270 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.470503 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.470588 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.470817 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.470915 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.471146 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.471233 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.471462 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.471545 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.471778 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.471891 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.472095 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.472181 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.472408 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.472501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.472721 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.472808 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.473056 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.473144 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.473371 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.473466 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.473685 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.473778 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.473997 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.474089 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.474306 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.474398 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.474621 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.474705 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.474931 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.475015 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.475245 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.475406 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.475553 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.475683 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.475851 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.475988 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.476158 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.476311 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.476470 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.476602 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.476770 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.476907 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.477121 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.477276 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.477442 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.477580 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.477748 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.477884 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.478075 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.478231 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.478365 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.478504 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.478677 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.478814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.478984 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.479128 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.479294 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.479430 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.479601 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.479746 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.479913 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.480063 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.480220 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.480360 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.480539 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.480674 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.480856 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.481056 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.481301 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.481461 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.481675 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.481785 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.481994 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.482128 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.482309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.482451 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.482637 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.482770 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.482965 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.483102 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.483280 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.483416 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.483596 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.483733 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.483912 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.484051 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.484224 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.484360 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.484537 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.484681 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.484852 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.485006 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.485194 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.485322 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.485511 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.485610 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.485828 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.485916 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.486139 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.486233 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.486452 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.486546 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.486811 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.486902 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.494349 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.494460 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.494548 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.494652 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.494736 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.494864 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.494955 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495304 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495304 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495538 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495619 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495699 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495777 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495843 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495843 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.495978 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496052 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496118 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496195 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496273 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496273 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496398 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496471 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496536 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.496607 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497238 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497321 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497387 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497466 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497535 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497599 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497672 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497738 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497802 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.497942 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498063 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498151 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498230 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498307 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498385 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498474 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498554 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498633 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498753 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498859 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.498947 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499043 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499216 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499216 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499372 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499513 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499612 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499693 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499772 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.499928 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500018 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500099 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500177 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500254 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500332 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500418 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500509 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500590 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500675 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500755 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500833 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.500910 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501050 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501136 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501215 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501307 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501389 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501477 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501559 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501638 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501716 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501716 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501858 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.501949 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502074 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502162 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502422 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502518 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502599 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502687 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502768 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502845 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.502924 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503008 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503100 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503100 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503258 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503339 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503424 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503503 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503593 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503810 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503888 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.503974 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.504054 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.504145 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.504226 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.504313 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.504531 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.504680 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.504847 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.505030 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.505183 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.505285 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.505505 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.505631 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.505822 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.505912 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.506134 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.506222 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.506444 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.506541 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.506761 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.506896 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.507083 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.507180 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.507380 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.507467 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.507688 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.507775 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.507993 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.508078 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.508305 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.508391 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.508615 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.508703 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.508924 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.509042 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.509275 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.509370 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.509588 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.509896 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.509985 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.510210 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.510295 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.510521 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.510608 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.510829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.510916 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.511143 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.511231 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.511455 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.511550 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.511774 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.511862 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.512082 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.512214 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513405 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513526 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513526 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513677 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513677 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513830 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513911 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.513990 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.514202 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.514292 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.514516 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.514612 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.514833 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.514921 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.515145 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.515235 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.515459 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.515561 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.515768 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.515863 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.516080 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.516167 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.516389 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.516491 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.516697 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.516784 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.517019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.517165 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.517338 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.517479 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.517657 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.517793 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.517999 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.518148 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.518318 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.518458 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.518633 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.518772 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.518945 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.519085 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.519257 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.519396 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.519865 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.520014 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.520181 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.520341 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.520549 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.520685 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.520863 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.521040 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.521216 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.521354 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.521535 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.521681 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.521859 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.521998 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.522170 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.522341 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.522496 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.522636 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.522793 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.522929 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.523114 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.523338 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.523485 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.523622 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.523771 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.523916 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.524052 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.524195 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.524338 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.524500 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.524670 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.524810 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.525005 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.525161 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.525327 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.525464 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.525640 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.525779 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.525958 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.526051 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.526271 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.526359 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.526588 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.526716 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.526905 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.527002 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.527219 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.527306 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.527533 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.527619 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.527846 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.527943 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.528200 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.528352 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.528622 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529158 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529252 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529334 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529414 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529501 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529581 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529675 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529776 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.529954 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.530043 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.530267 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.530356 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.530598 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.530700 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.530914 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.531003 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.531235 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.531324 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.531549 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.531637 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.531886 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.531997 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.532202 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.532321 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.532516 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.532641 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.532833 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.532954 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.533172 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.533315 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.533612 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.533700 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.533933 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.534022 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.534253 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.534348 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.534562 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.534649 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.534876 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.534997 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.535195 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.535318 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.535518 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.535635 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.535842 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.536031 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.536157 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.536346 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.536595 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.536691 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.536914 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.537023 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.537261 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.537358 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.537579 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.537667 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.537891 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.537980 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.538202 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.538290 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.538520 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.538608 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.538850 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.538938 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.539163 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.539252 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.539475 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.539672 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.539787 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.539991 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.540117 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.540306 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.540443 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.540741 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.540855 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.541072 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.541155 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.541396 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.541487 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.541726 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.541814 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.542056 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.542189 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.542386 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.542508 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.542697 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.542826 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.543018 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.543159 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.543340 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.543489 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.544752 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.544880 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.544880 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545061 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545157 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545248 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545328 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545408 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545486 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545565 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545652 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545733 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.545812 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.546018 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.546149 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.546340 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.546430 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.546673 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.546761 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.547021 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.547115 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.547342 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.547430 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.547674 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.547765 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.548046 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.548140 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.548382 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.548471 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.548698 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.548786 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.549059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.549152 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.549354 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.549444 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.549666 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.549754 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.549979 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.550078 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.550296 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.550419 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.550605 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.550692 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.550914 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.551011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.551230 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.551323 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.551542 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.551635 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.551849 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.551946 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.552160 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.552247 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.552470 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.552563 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.552784 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.552895 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.553116 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.553205 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.553445 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.553546 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.553755 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.553851 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.554088 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.554175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.554402 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.554490 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.554728 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.554815 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.555041 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.555129 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.555353 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.555439 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.555662 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.555749 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.555971 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.556058 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.556282 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.556368 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.556595 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.556683 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.556905 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.557088 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.557281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.557381 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.557593 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.557690 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.557920 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.558017 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.558255 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.558350 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.558585 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.558671 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.558899 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.558984 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.559733 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.559837 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.560100 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.560666 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.560750 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.560838 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.560927 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561048 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561141 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561229 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561316 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561403 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561605 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561695 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.561915 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.562004 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.562229 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.562316 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.562539 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.562626 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.562873 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.563015 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.563150 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.563284 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.563432 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.563578 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.563740 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.563875 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.564051 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.564186 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.564388 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.564522 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.564676 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.564811 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.565003 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.565154 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.565321 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.565456 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.565629 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.565762 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.565941 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.566097 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.566244 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.566334 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.566590 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.566731 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.566899 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.567053 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.567341 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.567504 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.567666 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.567959 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.568096 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.568244 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.568387 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.568628 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.568769 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.568905 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.569080 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.569219 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.569353 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.569487 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.569621 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.569756 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.569901 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570049 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570195 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570329 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570475 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570584 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570667 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.570972 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.571108 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.571290 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.571425 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.571642 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.571883 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.572020 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.572224 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.572360 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.572549 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.572800 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.572958 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.573166 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.573302 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.573490 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.573636 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.573812 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.573956 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.574129 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.574264 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.574448 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.574604 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.574761 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.575494 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.575654 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.576529 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.576680 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.576768 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.576848 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.576936 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577041 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577125 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577218 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577325 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577449 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577570 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577688 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577805 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.577931 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.578051 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.578180 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.578512 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.578668 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.578826 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.578971 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.579112 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.579302 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.579440 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.579575 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.579811 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.579946 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.580079 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.580213 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.580343 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.580486 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.580615 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.580747 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.580927 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.581142 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.581278 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.581435 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.581570 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.581701 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.581831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.581960 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.582089 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.582229 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.582417 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.582523 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.582731 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.582821 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.583061 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.583159 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.583407 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.583505 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.583737 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.583826 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.584058 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.584148 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.584378 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.584468 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.584694 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.584782 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.585037 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.585265 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.585354 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.585583 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.585893 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.585992 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.586213 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.586302 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.586553 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.586642 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.586878 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.586978 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.587202 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.587289 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.587528 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.587618 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.587836 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.587933 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.588149 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.588237 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.588468 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.588556 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.588778 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.588872 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.589111 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.589256 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.589428 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.589516 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.589740 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.589830 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.590047 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.590142 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.590370 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.590457 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.590835 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.591368 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.591368 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.591521 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.591601 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.591689 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.591880 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.591973 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.592228 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.592315 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.592552 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.592642 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.592873 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.592962 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.593221 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.593324 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.593540 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.593640 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.593851 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.593939 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.594162 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.594256 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.594476 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.594571 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.594787 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.594875 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.595095 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.595181 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.595406 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.595503 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.595714 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.595800 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.596025 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.596111 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.596336 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.596478 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.596646 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.596733 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.596952 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.597078 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.597288 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.597377 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.597598 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.597685 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.597904 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.597998 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.598219 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.598346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.598528 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.598668 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.598834 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.598922 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.599145 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.599235 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.599451 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.599538 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.599756 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.599842 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.600064 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.600164 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.600371 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.600457 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.600683 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.600779 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.601006 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.601135 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.601323 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.601412 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.601630 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.601731 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.601943 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.602038 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.602298 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.602388 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.602620 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.602715 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.602930 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.603016 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.603246 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.603334 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.603570 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.603668 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.603885 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.603973 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.604203 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.604298 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.604519 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.604608 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.604834 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.604920 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.605179 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.605280 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.605499 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.605602 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.605851 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.606626 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.606821 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.607408 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.607408 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.607611 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.607698 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.607951 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.608027 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.608270 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.608360 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.608588 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.608672 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.608904 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.609060 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.609266 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.609345 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.609580 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.609657 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.609894 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.610031 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.610259 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.610390 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.610513 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.610631 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.610809 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.610963 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.611130 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.611321 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.611454 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.611586 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.611706 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.611846 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.612027 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.612164 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.612342 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.612495 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.612632 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.612780 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.612958 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.613123 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.613306 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.613517 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.613667 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.613815 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.613956 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.614096 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.614243 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.614381 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.614572 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.614707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.614894 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.615043 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.615200 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.615332 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.615520 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.615674 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.615836 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.615970 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.616151 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.616308 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.616461 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.616600 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.616770 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.616910 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.617088 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.617227 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.617418 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.617572 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.617756 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.617908 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.618076 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.618230 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.618389 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.618542 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.618773 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.618923 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.619086 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.619255 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.619395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.619542 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.619729 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.619880 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.620050 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.620186 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.620357 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.620483 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.620671 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.620783 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.621005 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.621115 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.621334 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.621430 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.621651 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.622299 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.622530 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.622612 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.622845 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.623015 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.623162 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.623365 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.623536 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.623706 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.623849 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.624022 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.624171 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.624338 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.624490 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.624666 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.624807 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.624975 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.625134 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.625356 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.625518 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.625662 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.625806 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.625950 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.626084 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.626246 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.626393 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.626545 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.626677 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.626812 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.627035 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.627186 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.627335 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.627478 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.627626 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.627767 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.627920 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.628065 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.628214 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.628349 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.628481 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.628627 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.628770 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.628895 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.629103 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.629231 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.629374 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.629494 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.629605 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.629747 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.629883 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.630137 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.630412 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.630724 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.631023 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.631175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.631312 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.631467 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.631603 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.631753 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.631943 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.632047 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.632284 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.632381 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.632609 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.632709 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.632924 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.633054 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.633267 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.633366 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.633596 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.633825 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.634034 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.634229 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.634428 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.634625 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.634831 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.635034 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.635231 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.635437 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.635632 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.635837 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.636033 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.636221 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.636400 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.636602 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.636792 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.637074 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.637074 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.637365 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.638195 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.638353 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.638489 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.638633 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.638633 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.638892 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.638892 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.639143 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.639272 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.639417 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.639555 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.639690 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.639840 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.639998 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.640145 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.640390 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.640547 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.640741 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.640961 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641111 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641199 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641363 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641457 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641539 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641625 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641706 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641794 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641876 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.641964 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642062 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642145 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642225 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642312 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642394 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642477 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642556 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642635 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642722 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642810 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642891 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.642970 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.643048 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.643180 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.643360 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.643516 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.643695 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.643864 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.644029 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.644184 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.644386 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.644780 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.644961 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.645148 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.645335 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.645470 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.645675 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.645787 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.645999 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.646087 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.646320 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.646409 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 12:45:21.646637 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:45:21.646889 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 12:45:21.673306 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_db.sqlalchemy.engines [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:21.676103 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_db.sqlalchemy.engines [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:21.742860 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.context [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24af8c6d-20c5-4c42-8aad-3b952e53d778(cell1) {{(pid=109062) load_cells /opt/stack/nova/nova/context.py:464}} May 13 12:45:21.745389 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.context [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24af8c6d-20c5-4c42-8aad-3b952e53d778(cell1) {{(pid=109061) load_cells /opt/stack/nova/nova/context.py:464}} May 13 12:45:21.747367 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:45:21.748975 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:45:21.750344 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_concurrency.lockutils [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:45:21.750566 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:45:21.751941 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_concurrency.lockutils [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:45:21.752333 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:45:21.752760 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_concurrency.lockutils [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:45:21.754944 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_concurrency.lockutils [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:45:21.764444 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_db.sqlalchemy.engines [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:21.767518 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_db.sqlalchemy.engines [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:21.772791 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_db.sqlalchemy.engines [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:21.775235 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_db.sqlalchemy.engines [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:21.933039 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_db.sqlalchemy.engines [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:21.936717 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG oslo_db.sqlalchemy.engines [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:45:22.283933 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: WARNING keystonemiddleware.auth_token [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:45:22.291408 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: WARNING keystonemiddleware.auth_token [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:45:22.292716 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: WARNING keystonemiddleware.auth_token [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:45:22.301271 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: WARNING keystonemiddleware.auth_token [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:45:22.640204 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: WARNING keystonemiddleware.auth_token [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:45:22.646588 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: WARNING keystonemiddleware.auth_token [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:45:22.652734 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ddbe8879c0 pid: 109062 (default app) May 13 12:45:22.652841 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: WARNING keystonemiddleware.auth_token [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:45:22.655056 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:45:22.656234 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 May 13 12:45:22.656915 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Fri May 13 12:45:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:45:22.660017 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: WARNING keystonemiddleware.auth_token [None req-21393658-2099-44ac-853a-c0f973852fa9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:45:22.665290 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ddbe8879c0 pid: 109061 (default app) May 13 12:46:43.036496 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:43.038229 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 May 13 12:46:43.038807 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:46:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:46:43.460286 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-5b94fb0c-39ed-46c4-8e5b-fea87dd8c939 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:43.494093 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-5b94fb0c-39ed-46c4-8e5b-fea87dd8c939 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448182 May 13 12:46:43.502094 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Fri May 13 12:46:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:46:45.921553 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:45.922556 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-e7dda383-a4e5-4ac5-b4a1-6595fc341082 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 May 13 12:46:45.922959 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:46:46.005008 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-1a81e53a-0317-4369-8ebb-b2d5b0d5593a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "ram": 256, "disk": 1}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:46.026392 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:46:46.026392 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: warnings.warn(msg) May 13 12:46:46.060238 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-1a81e53a-0317-4369-8ebb-b2d5b0d5593a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.130698 May 13 12:46:46.062034 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:46:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:46:46.289884 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-6c52c886-3249-4ab1-acfd-99318925d942 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:46.292160 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:46:46.292160 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: warnings.warn(msg) May 13 12:46:46.351865 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-6c52c886-3249-4ab1-acfd-99318925d942 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281750 May 13 12:46:46.361084 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Fri May 13 12:46:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:46:48.771056 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-1a81e53a-0317-4369-8ebb-b2d5b0d5593a admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:48.772070 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-1a81e53a-0317-4369-8ebb-b2d5b0d5593a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 13 12:46:48.772474 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:46:48.898781 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-30477d2a-e4b0-4483-aa26-6d20a30a11ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 5, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:48.917600 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:46:48.917600 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: warnings.warn(msg) May 13 12:46:48.938801 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-30477d2a-e4b0-4483-aa26-6d20a30a11ab admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160089 May 13 12:46:48.939373 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:46:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 12:46:48.951220 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-bc41b769-bc34-4e61-83e8-45c623964176 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:48.953274 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:46:48.953274 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: warnings.warn(msg) May 13 12:46:48.992508 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-bc41b769-bc34-4e61-83e8-45c623964176 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044647 May 13 12:46:48.994001 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Fri May 13 12:46:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:46:51.439239 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-30477d2a-e4b0-4483-aa26-6d20a30a11ab admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:51.440257 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-30477d2a-e4b0-4483-aa26-6d20a30a11ab admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 13 12:46:51.440666 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:46:51.517170 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-995dd352-3f97-47e7-b139-5ccd80138bb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:51.536215 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-995dd352-3f97-47e7-b139-5ccd80138bb0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089298 May 13 12:46:51.543749 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:46:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 12:46:51.552203 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-4f656c29-fb4b-4e21-8306-8b6f877bfacb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:51.578330 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-4f656c29-fb4b-4e21-8306-8b6f877bfacb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033108 May 13 12:46:51.579295 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Fri May 13 12:46:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) May 13 12:46:53.973738 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-995dd352-3f97-47e7-b139-5ccd80138bb0 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:53.974763 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-995dd352-3f97-47e7-b139-5ccd80138bb0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 13 12:46:53.975173 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:46:54.043490 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-50ef58d9-f113-48fa-aa63-15db3104e891 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:54.062576 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-50ef58d9-f113-48fa-aa63-15db3104e891 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080911 May 13 12:46:54.063139 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:46:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:46:54.083837 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-dd77200f-47a2-4d30-bd1b-e45fdbd6b7b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:54.112235 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-dd77200f-47a2-4d30-bd1b-e45fdbd6b7b2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032103 May 13 12:46:54.112821 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Fri May 13 12:46:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:46:56.464432 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-50ef58d9-f113-48fa-aa63-15db3104e891 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:56.465489 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-50ef58d9-f113-48fa-aa63-15db3104e891 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 13 12:46:56.465892 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:46:56.527407 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-bced1bc1-2ad1-4546-b136-5a9e6170682c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:56.546640 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-bced1bc1-2ad1-4546-b136-5a9e6170682c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074101 May 13 12:46:56.547300 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:46:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:46:56.559111 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-9911d86c-95e4-4e48-9f2a-39d9287efda6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:46:56.582980 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-9911d86c-95e4-4e48-9f2a-39d9287efda6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027444 May 13 12:46:56.583862 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Fri May 13 12:46:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:46:58.917346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-bced1bc1-2ad1-4546-b136-5a9e6170682c admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:58.918396 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-bced1bc1-2ad1-4546-b136-5a9e6170682c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 13 12:46:58.918821 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:46:58.989934 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-1745b051-e268-49f8-a947-dff9f0a891d3 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:46:59.014885 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-1745b051-e268-49f8-a947-dff9f0a891d3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088448 May 13 12:46:59.020877 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Fri May 13 12:46:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:47:01.642520 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-bced1bc1-2ad1-4546-b136-5a9e6170682c admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:01.643632 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-bced1bc1-2ad1-4546-b136-5a9e6170682c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 13 12:47:01.644176 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:47:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:01.721284 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-0ca7ccf0-8c26-47dd-a2ef-7693453d46fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:01.742919 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-0ca7ccf0-8c26-47dd-a2ef-7693453d46fe admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.092830 May 13 12:47:01.743715 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:47:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:01.758245 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-1e793164-4c8d-47b7-b1b5-fac05bec3525 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:01.796754 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-1e793164-4c8d-47b7-b1b5-fac05bec3525 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042701 May 13 12:47:01.797698 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Fri May 13 12:47:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:47:04.162805 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-0ca7ccf0-8c26-47dd-a2ef-7693453d46fe admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:04.163813 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-0ca7ccf0-8c26-47dd-a2ef-7693453d46fe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 13 12:47:04.164217 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:04.236420 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-9f9e838b-6733-44d4-a53e-3fb338fab93f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:04.262026 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-9f9e838b-6733-44d4-a53e-3fb338fab93f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091241 May 13 12:47:04.262026 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:47:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:04.280660 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-265a87e0-d092-4384-a2bd-1a60f9ce129e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:04.303148 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-265a87e0-d092-4384-a2bd-1a60f9ce129e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026808 May 13 12:47:04.303742 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Fri May 13 12:47:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:47:07.097979 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-9f9e838b-6733-44d4-a53e-3fb338fab93f admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:07.098994 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-9f9e838b-6733-44d4-a53e-3fb338fab93f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 13 12:47:07.099649 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:07.175974 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-b01aea28-a978-42e4-9f0a-78978785748b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "swap": 0, "id": "3", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:07.195201 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-b01aea28-a978-42e4-9f0a-78978785748b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.089631 May 13 12:47:07.195754 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:47:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:07.208306 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-fbdccbf7-5270-473d-83fe-97eb4f152f7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:07.234131 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-fbdccbf7-5270-473d-83fe-97eb4f152f7d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029451 May 13 12:47:07.234652 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Fri May 13 12:47:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:47:09.535189 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-b01aea28-a978-42e4-9f0a-78978785748b admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:09.536185 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-b01aea28-a978-42e4-9f0a-78978785748b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 13 12:47:09.536581 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:09.614178 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-d0270077-07ca-46f9-a2b7-99b5d5d2a0c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:09.634000 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-d0270077-07ca-46f9-a2b7-99b5d5d2a0c8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091508 May 13 12:47:09.634550 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:47:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:09.646893 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-a01484e5-f71f-46f0-8f09-91e54a76915b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:09.671895 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-a01484e5-f71f-46f0-8f09-91e54a76915b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029418 May 13 12:47:09.672729 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Fri May 13 12:47:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:47:12.106339 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-d0270077-07ca-46f9-a2b7-99b5d5d2a0c8 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:12.108542 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-d0270077-07ca-46f9-a2b7-99b5d5d2a0c8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002649 May 13 12:47:12.109236 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:12.198617 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-d32ec901-ba50-4dc5-b932-c35329b15ad7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:12.230261 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-d32ec901-ba50-4dc5-b932-c35329b15ad7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.114197 May 13 12:47:12.231567 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Fri May 13 12:47:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:12.249454 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-061ee471-8d82-45e9-bf85-f4e7badd496d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:12.273694 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-061ee471-8d82-45e9-bf85-f4e7badd496d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033111 May 13 12:47:12.274559 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Fri May 13 12:47:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:47:36.130357 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-d32ec901-ba50-4dc5-b932-c35329b15ad7 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:36.131408 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-d32ec901-ba50-4dc5-b932-c35329b15ad7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 13 12:47:36.131870 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:47:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:36.210222 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-6f5c40f2-3395-4407-b275-71cf011d7025 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:36.227981 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-6f5c40f2-3395-4407-b275-71cf011d7025 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.088989 May 13 12:47:36.228604 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Fri May 13 12:47:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:47:37.264885 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-d32ec901-ba50-4dc5-b932-c35329b15ad7 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:37.265938 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-d32ec901-ba50-4dc5-b932-c35329b15ad7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 13 12:47:37.266355 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:37.472916 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-93765124-bf73-449d-9e4b-7fbe8ca984c3 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:37.478768 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.wsgi [None req-93765124-bf73-449d-9e4b-7fbe8ca984c3 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-93765124-bf73-449d-9e4b-7fbe8ca984c3 admin admin] Request method failure captured: May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Accept: application/json May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Accept-Encoding: gzip, deflate May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Connection: keep-alive May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Content-Length: 0 May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Host: 10.222.0.49 May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Openstack-Api-Version: compute 2.90 May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Openstack-System-Scope: None May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: User-Agent: python-novaclient May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Auth-Token: gAAAAABiflNp7iUbrq_b3kNbQI0jenDpLtDnBEF1yQXcxrFDq7pFFbrxh-aYoH9y98zZXrl37FkxAX_2WZmu1q0vLP0cyr_bInVXA2zy3VyilEvL6pcWZSO3YJ2YE_DXkgTqV2gCh5jh79X24Z6-XSg1j2KlMpmwIAnWVtzEK28Ui1Z9TU0BEyE May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Domain-Id: None May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Domain-Name: None May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Identity-Status: Confirmed May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Is-Admin-Project: True May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Openstack-Nova-Api-Version: 2.90 May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Domain-Id: default May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Domain-Name: Default May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Name: admin May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Role: reader,member,admin May 13 12:47:37.482501 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Roles: reader,member,admin May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a91e56fe3d748728a2efec64d71ac50", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant: admin May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant-Name: admin May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User: admin May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Domain-Id: default May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Domain-Name: Default May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Id: 94afba6895414851b5641f8db5e9fdde May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Name: admin May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: method: > May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: exception: Flavor 42 could not be found. May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: action_args: {'id': '42'} May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:47:37.484177 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:37.485175 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:37.486366 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-93765124-bf73-449d-9e4b-7fbe8ca984c3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:47:37.487507 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-93765124-bf73-449d-9e4b-7fbe8ca984c3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062784 May 13 12:47:37.487507 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Fri May 13 12:47:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 12:47:37.493667 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-9ca33870-96c1-4e41-93ac-07b7e6630d08 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:37.516034 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-9ca33870-96c1-4e41-93ac-07b7e6630d08 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025809 May 13 12:47:37.516604 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Fri May 13 12:47:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:47:37.538919 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-cc523431-f2ca-4c24-9b31-e56fce4e355c admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:37.560488 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-cc523431-f2ca-4c24-9b31-e56fce4e355c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025162 May 13 12:47:37.561035 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Fri May 13 12:47:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:47:37.570490 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-0bb3933d-b534-457e-bc19-cadc2868944d admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:37.576036 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.wsgi [None req-0bb3933d-b534-457e-bc19-cadc2868944d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-0bb3933d-b534-457e-bc19-cadc2868944d admin admin] Request method failure captured: May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Accept: application/json May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Accept-Encoding: gzip, deflate May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Connection: keep-alive May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Content-Length: 0 May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Host: 10.222.0.49 May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Openstack-Api-Version: compute 2.90 May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Openstack-System-Scope: None May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: User-Agent: python-novaclient May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Auth-Token: gAAAAABiflNp7iUbrq_b3kNbQI0jenDpLtDnBEF1yQXcxrFDq7pFFbrxh-aYoH9y98zZXrl37FkxAX_2WZmu1q0vLP0cyr_bInVXA2zy3VyilEvL6pcWZSO3YJ2YE_DXkgTqV2gCh5jh79X24Z6-XSg1j2KlMpmwIAnWVtzEK28Ui1Z9TU0BEyE May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Domain-Id: None May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Domain-Name: None May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Identity-Status: Confirmed May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Is-Admin-Project: True May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Openstack-Nova-Api-Version: 2.90 May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Domain-Id: default May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Domain-Name: Default May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Name: admin May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Role: reader,member,admin May 13 12:47:37.579281 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Roles: reader,member,admin May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a91e56fe3d748728a2efec64d71ac50", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant: admin May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant-Name: admin May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User: admin May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Domain-Id: default May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Domain-Name: Default May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Id: 94afba6895414851b5641f8db5e9fdde May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Name: admin May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: method: > May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: exception: Flavor 42 could not be found. May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: action_args: {'id': '42'} May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:47:37.580831 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:37.581814 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:37.583309 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-0bb3933d-b534-457e-bc19-cadc2868944d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:47:37.584518 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-0bb3933d-b534-457e-bc19-cadc2868944d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013811 May 13 12:47:37.584518 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Fri May 13 12:47:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 12:47:38.468376 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-cc523431-f2ca-4c24-9b31-e56fce4e355c admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:38.469429 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-cc523431-f2ca-4c24-9b31-e56fce4e355c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 13 12:47:38.469833 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:38.660649 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-691ddbed-639f-4c88-9190-5d6eaa010723 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:38.665914 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.wsgi [None req-691ddbed-639f-4c88-9190-5d6eaa010723 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-691ddbed-639f-4c88-9190-5d6eaa010723 admin admin] Request method failure captured: May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Accept: application/json May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Accept-Encoding: gzip, deflate May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Connection: keep-alive May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Content-Length: 0 May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Host: 10.222.0.49 May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Openstack-Api-Version: compute 2.90 May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Openstack-System-Scope: None May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: User-Agent: python-novaclient May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Auth-Token: gAAAAABiflNqOFeE_f5HPNoRSgfrcBZnNz_AUL6siZPQQt6orT1hlxqB0eAamOLEds_0-tQzI4wJOl_yJ0DSU3Mp4N9nlk-7S1CDBMfMoMNWtad3Po0fUR6eFxjlpc4xpVDmcrrAzsf0NmNkqNFClfpQxpCbjo-21Bu08Z_W_Q7jzlcZh-_K64c May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Domain-Id: None May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Domain-Name: None May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Identity-Status: Confirmed May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Is-Admin-Project: True May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Openstack-Nova-Api-Version: 2.90 May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Domain-Id: default May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Domain-Name: Default May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Name: admin May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Role: reader,member,admin May 13 12:47:38.667395 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Roles: reader,member,admin May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a91e56fe3d748728a2efec64d71ac50", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant: admin May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant-Name: admin May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User: admin May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Domain-Id: default May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Domain-Name: Default May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Id: 94afba6895414851b5641f8db5e9fdde May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Name: admin May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: method: > May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: exception: Flavor 84 could not be found. May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: action_args: {'id': '84'} May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:47:38.669498 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:38.670483 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:38.672011 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-691ddbed-639f-4c88-9190-5d6eaa010723 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:47:38.673946 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-691ddbed-639f-4c88-9190-5d6eaa010723 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059936 May 13 12:47:38.673946 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Fri May 13 12:47:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 12:47:38.682601 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-6b112dec-7ea4-477a-bc28-3f97fed62f3e admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:38.696620 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-6b112dec-7ea4-477a-bc28-3f97fed62f3e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017825 May 13 12:47:38.697180 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Fri May 13 12:47:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:47:38.707041 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-ba412df7-1512-47e6-a344-40b44b8e115a admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:38.722705 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-ba412df7-1512-47e6-a344-40b44b8e115a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019078 May 13 12:47:38.723263 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Fri May 13 12:47:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:47:38.736332 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-14e7c5c1-b93a-4f13-9681-08ff03f7bbcb admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:38.741814 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.wsgi [None req-14e7c5c1-b93a-4f13-9681-08ff03f7bbcb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-14e7c5c1-b93a-4f13-9681-08ff03f7bbcb admin admin] Request method failure captured: May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Accept: application/json May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Accept-Encoding: gzip, deflate May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Connection: keep-alive May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Content-Length: 0 May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Host: 10.222.0.49 May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Openstack-Api-Version: compute 2.90 May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Openstack-System-Scope: None May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: User-Agent: python-novaclient May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Auth-Token: gAAAAABiflNqOFeE_f5HPNoRSgfrcBZnNz_AUL6siZPQQt6orT1hlxqB0eAamOLEds_0-tQzI4wJOl_yJ0DSU3Mp4N9nlk-7S1CDBMfMoMNWtad3Po0fUR6eFxjlpc4xpVDmcrrAzsf0NmNkqNFClfpQxpCbjo-21Bu08Z_W_Q7jzlcZh-_K64c May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Domain-Id: None May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Domain-Name: None May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Identity-Status: Confirmed May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Is-Admin-Project: True May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Openstack-Nova-Api-Version: 2.90 May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Domain-Id: default May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Domain-Name: Default May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Name: admin May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Role: reader,member,admin May 13 12:47:38.743346 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Roles: reader,member,admin May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a91e56fe3d748728a2efec64d71ac50", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant: admin May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant-Name: admin May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User: admin May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Domain-Id: default May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Domain-Name: Default May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Id: 94afba6895414851b5641f8db5e9fdde May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Name: admin May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: method: > May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: exception: Flavor 84 could not be found. May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: action_args: {'id': '84'} May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:47:38.744894 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:38.746077 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:38.748241 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-14e7c5c1-b93a-4f13-9681-08ff03f7bbcb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:47:38.749639 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-14e7c5c1-b93a-4f13-9681-08ff03f7bbcb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015705 May 13 12:47:38.749639 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Fri May 13 12:47:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 12:47:39.653547 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-ba412df7-1512-47e6-a344-40b44b8e115a admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:39.654576 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-ba412df7-1512-47e6-a344-40b44b8e115a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 13 12:47:39.654972 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:39.845468 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-d217e79e-ce0b-4539-821f-14ed9003a025 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:39.851593 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.wsgi [None req-d217e79e-ce0b-4539-821f-14ed9003a025 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-d217e79e-ce0b-4539-821f-14ed9003a025 admin admin] Request method failure captured: May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Accept: application/json May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Accept-Encoding: gzip, deflate May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Connection: keep-alive May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Content-Length: 0 May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Host: 10.222.0.49 May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Openstack-Api-Version: compute 2.90 May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Openstack-System-Scope: None May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: User-Agent: python-novaclient May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Auth-Token: gAAAAABiflNrwZjROOaFQIxFSYTr2rI3mO7EIZcVIS9I-n7nCbqpD2pBsafl7WaJ59LDHBwpqkvH4bMhza9D-GfSQ1FCTVGjzmxc3C3BAtuMnkoP1J2CkGGox6l-K3DgQqmL5KpTUTtnLh-Z7JhVV6iQZ5tlH4XMsN9_-HlaEnJB9rZlydrqAb0 May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Domain-Id: None May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Domain-Name: None May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Identity-Status: Confirmed May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Is-Admin-Project: True May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Openstack-Nova-Api-Version: 2.90 May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Domain-Id: default May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Domain-Name: Default May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Project-Name: admin May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Role: reader,member,admin May 13 12:47:39.853127 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Roles: reader,member,admin May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a91e56fe3d748728a2efec64d71ac50", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant: admin May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-Tenant-Name: admin May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User: admin May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Domain-Id: default May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Domain-Name: Default May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Id: 94afba6895414851b5641f8db5e9fdde May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: X-User-Name: admin May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: method: > May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: exception: Flavor 451 could not be found. May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: action_args: {'id': '451'} May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:47:39.854656 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:39.857726 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: ERROR nova.api.openstack.wsgi May 13 12:47:39.859019 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-d217e79e-ce0b-4539-821f-14ed9003a025 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:47:39.860252 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-d217e79e-ce0b-4539-821f-14ed9003a025 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061475 May 13 12:47:39.860252 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Fri May 13 12:47:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 12:47:39.864361 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-78043d5e-4aaf-4188-8411-05f8ed0bd683 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:39.878457 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-78043d5e-4aaf-4188-8411-05f8ed0bd683 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017647 May 13 12:47:39.878984 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Fri May 13 12:47:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:47:39.888998 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:39.903382 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018545 May 13 12:47:39.903920 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Fri May 13 12:47:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:47:39.913250 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-d7e635a7-038a-4a6a-8b38-4233a1e92837 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:39.918569 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.wsgi [None req-d7e635a7-038a-4a6a-8b38-4233a1e92837 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-d7e635a7-038a-4a6a-8b38-4233a1e92837 admin admin] Request method failure captured: May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Accept: application/json May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Accept-Encoding: gzip, deflate May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Connection: keep-alive May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Content-Length: 0 May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Host: 10.222.0.49 May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Openstack-Api-Version: compute 2.90 May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Openstack-System-Scope: None May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: User-Agent: python-novaclient May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Auth-Token: gAAAAABiflNrwZjROOaFQIxFSYTr2rI3mO7EIZcVIS9I-n7nCbqpD2pBsafl7WaJ59LDHBwpqkvH4bMhza9D-GfSQ1FCTVGjzmxc3C3BAtuMnkoP1J2CkGGox6l-K3DgQqmL5KpTUTtnLh-Z7JhVV6iQZ5tlH4XMsN9_-HlaEnJB9rZlydrqAb0 May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Domain-Id: None May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Domain-Name: None May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Identity-Status: Confirmed May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Is-Admin-Project: True May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Openstack-Nova-Api-Version: 2.90 May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Domain-Id: default May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Domain-Name: Default May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Project-Name: admin May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Role: reader,member,admin May 13 12:47:39.920059 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Roles: reader,member,admin May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a91e56fe3d748728a2efec64d71ac50", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a91e56fe3d748728a2efec64d71ac50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant: admin May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant-Id: 1a91e56fe3d748728a2efec64d71ac50 May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-Tenant-Name: admin May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User: admin May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Domain-Id: default May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Domain-Name: Default May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Id: 94afba6895414851b5641f8db5e9fdde May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: X-User-Name: admin May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: method: > May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: exception: Flavor 451 could not be found. May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: action_args: {'id': '451'} May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:47:39.921829 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:39.922850 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: ERROR nova.api.openstack.wsgi May 13 12:47:39.924707 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-d7e635a7-038a-4a6a-8b38-4233a1e92837 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:47:39.925952 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-d7e635a7-038a-4a6a-8b38-4233a1e92837 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011891 May 13 12:47:39.925952 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Fri May 13 12:47:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 12:47:40.824838 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:40.825884 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 13 12:47:40.826295 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:41.022787 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-a38e7389-f1ee-4a23-9422-e2e246715d90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:41.040589 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-a38e7389-f1ee-4a23-9422-e2e246715d90 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070007 May 13 12:47:41.041155 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Fri May 13 12:47:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 12:47:41.946655 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:41.947655 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 13 12:47:41.948067 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:42.138297 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-2e7152bb-7718-4387-a2c1-754b090f714d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:42.156190 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-2e7152bb-7718-4387-a2c1-754b090f714d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071641 May 13 12:47:42.156643 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Fri May 13 12:47:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:43.065320 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:43.066363 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 13 12:47:43.066766 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:43.268841 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-536224d8-de33-4430-a0ed-d11cddfb12bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:43.287218 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-536224d8-de33-4430-a0ed-d11cddfb12bd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070817 May 13 12:47:43.287764 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Fri May 13 12:47:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:44.186496 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:44.187633 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 13 12:47:44.188030 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:44.379974 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-6c9bd3f1-d554-484f-ab7d-73515a342aff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:47:44.401230 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-6c9bd3f1-d554-484f-ab7d-73515a342aff admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076383 May 13 12:47:44.401679 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Fri May 13 12:47:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:47:45.313454 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:45.314455 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 13 12:47:45.314997 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:47:45.503371 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-91c8c47e-1730-4f49-bd35-ce4a8753d455 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:47:45.522789 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-91c8c47e-1730-4f49-bd35-ce4a8753d455 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069796 May 13 12:47:45.523256 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Fri May 13 12:47:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:48:49.302784 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:48:49.303831 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-050557ec-7296-4ef9-994a-db055147e749 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 13 12:48:49.304238 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Fri May 13 12:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:48:49.365083 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-925eaa84-335c-49a3-826a-83593cbb2f80 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:48:49.384356 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-925eaa84-335c-49a3-826a-83593cbb2f80 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072961 May 13 12:48:49.385511 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Fri May 13 12:48:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:48:49.409152 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-7641d588-184d-4bab-8447-ff8ef19fc448 admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:48:49.417481 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-7641d588-184d-4bab-8447-ff8ef19fc448 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012322 May 13 12:48:49.418063 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Fri May 13 12:48:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:48:49.430207 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-9b2e17a2-f4b3-482b-9589-a18cee338799 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:48:49.438700 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-9b2e17a2-f4b3-482b-9589-a18cee338799 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012120 May 13 12:48:49.439264 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Fri May 13 12:48:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:48:49.451810 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:48:49.459819 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012442 May 13 12:48:49.460383 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Fri May 13 12:48:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:48:49.472118 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-21e8f551-5f51-4476-9fb0-5a2d7f66d1eb admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:48:49.480579 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-21e8f551-5f51-4476-9fb0-5a2d7f66d1eb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012082 May 13 12:48:49.481158 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Fri May 13 12:48:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:52:15.067762 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:15.068780 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 13 12:52:15.069460 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:52:15.342613 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-55b688ef-a703-402c-88aa-317f7471ef2a admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:15.343775 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:52:15.343775 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: warnings.warn(msg) May 13 12:52:15.345036 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-55b688ef-a703-402c-88aa-317f7471ef2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:15.345482 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-55b688ef-a703-402c-88aa-317f7471ef2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:15.346322 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-55b688ef-a703-402c-88aa-317f7471ef2a admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:15.346751 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-55b688ef-a703-402c-88aa-317f7471ef2a admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:15.380823 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-55b688ef-a703-402c-88aa-317f7471ef2a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154087 May 13 12:52:15.381426 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Fri May 13 12:52:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:52:16.320642 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:16.321823 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 May 13 12:52:16.322425 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:52:16.522324 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-28c165de-3f46-4357-a5a4-48f8a8062b62 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:16.523505 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:52:16.523505 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: warnings.warn(msg) May 13 12:52:16.524693 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-28c165de-3f46-4357-a5a4-48f8a8062b62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:16.525845 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-28c165de-3f46-4357-a5a4-48f8a8062b62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:16.526606 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-28c165de-3f46-4357-a5a4-48f8a8062b62 admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:16.527039 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-28c165de-3f46-4357-a5a4-48f8a8062b62 admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:16.546200 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-28c165de-3f46-4357-a5a4-48f8a8062b62 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076834 May 13 12:52:16.546693 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Fri May 13 12:52:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:52:27.906316 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:27.907325 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 13 12:52:27.907727 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:52:28.105608 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-0f184693-1c71-4e86-85d0-1720f56c8880 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:28.106824 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:52:28.106824 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: warnings.warn(msg) May 13 12:52:28.108062 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-0f184693-1c71-4e86-85d0-1720f56c8880 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:28.108510 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-0f184693-1c71-4e86-85d0-1720f56c8880 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:28.109339 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-0f184693-1c71-4e86-85d0-1720f56c8880 admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:28.109774 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-0f184693-1c71-4e86-85d0-1720f56c8880 admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:28.134406 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-0f184693-1c71-4e86-85d0-1720f56c8880 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086221 May 13 12:52:28.135013 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Fri May 13 12:52:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:52:29.074886 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: DEBUG nova.api.openstack.wsgi [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] Calling method '>' {{(pid=109061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:29.075969 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: INFO nova.api.openstack.requestlog [None req-c9c67a51-7a57-468d-9ab0-d79ba531a0bc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 13 12:52:29.076372 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: [pid: 109061|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Fri May 13 12:52:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:52:29.271426 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG nova.api.openstack.wsgi [None req-7d0b561b-5636-4bc4-92d7-ffa9a861d4f9 admin admin] Calling method '>' {{(pid=109062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:52:29.272870 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:52:29.272870 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: warnings.warn(msg) May 13 12:52:29.274170 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-7d0b561b-5636-4bc4-92d7-ffa9a861d4f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:29.274617 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-7d0b561b-5636-4bc4-92d7-ffa9a861d4f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:29.275564 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-7d0b561b-5636-4bc4-92d7-ffa9a861d4f9 admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:52:29.276002 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: DEBUG oslo_concurrency.lockutils [None req-7d0b561b-5636-4bc4-92d7-ffa9a861d4f9 admin admin] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:52:29.298927 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: INFO nova.api.openstack.requestlog [None req-7d0b561b-5636-4bc4-92d7-ffa9a861d4f9 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081932 May 13 12:52:29.299495 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: [pid: 109062|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Fri May 13 12:52:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:53:29.776008 dv-cinder-841644-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 12:53:29.776612 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: Fri May 13 12:53:29 2022 - graceful shutdown triggered... May 13 12:53:29.777117 dv-cinder-841644-1-iscsi devstack@n-api.service[109061]: Gracefully killing worker 1 (pid: 109061)... May 13 12:53:29.777524 dv-cinder-841644-1-iscsi devstack@n-api.service[109062]: Gracefully killing worker 2 (pid: 109062)... May 13 12:53:30.778008 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: worker 1 buried after 1 seconds May 13 12:53:30.778583 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: worker 2 buried after 1 seconds May 13 12:53:30.778583 dv-cinder-841644-1-iscsi devstack@n-api.service[109060]: goodbye to uWSGI. May 13 12:53:30.779577 dv-cinder-841644-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 12:53:30.780140 dv-cinder-841644-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 12:53:30.782841 dv-cinder-841644-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 12:53:30.799145 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 12:53:30 2022] *** May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: nodename: dv-cinder-841644-1-iscsi May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: machine: x86_64 May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: clock source: unix May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: pcre jit disabled May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: detected number of CPU cores: 4 May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: current working directory: / May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: detected binary path: /usr/bin/uwsgi-core May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: your processes number limit is 47680 May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: your memory page size is 4096 bytes May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: detected max file descriptor number: 2048 May 13 12:53:30.816294 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: lock engine: pthread robust mutexes May 13 12:53:30.818366 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: thunder lock: enabled May 13 12:53:30.818366 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 12:53:30.818366 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 12:53:30.863762 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: Python main interpreter initialized at 0x55b0263249c0 May 13 12:53:30.863878 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: python threads support enabled May 13 12:53:30.863878 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: your server socket listen backlog is limited to 100 connections May 13 12:53:30.863878 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: your mercy for graceful operations on workers is 90 seconds May 13 12:53:30.864106 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: mapped 403077 bytes (393 KB) for 2 cores May 13 12:53:30.864186 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: *** Operational MODE: preforking *** May 13 12:53:30.864465 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: *** uWSGI is running in multiple interpreter mode *** May 13 12:53:30.864465 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: spawned uWSGI master process (pid: 123391) May 13 12:53:30.864662 dv-cinder-841644-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 12:53:30.865568 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: spawned uWSGI worker 1 (pid: 123409, cores: 1) May 13 12:53:30.865686 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: spawned uWSGI worker 2 (pid: 123410, cores: 1) May 13 12:53:30.865860 dv-cinder-841644-1-iscsi devstack@n-api.service[123391]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 12:53:32.123144 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 12:53:32.137185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 12:53:32.938825 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:53:32.938825 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: from cryptography.utils import int_from_bytes May 13 12:53:32.939144 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:53:32.939144 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: from cryptography.utils import int_from_bytes May 13 12:53:32.964584 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:53:32.964584 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: from cryptography.utils import int_from_bytes May 13 12:53:32.966093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:53:32.966093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: from cryptography.utils import int_from_bytes May 13 12:53:35.384175 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 12:53:35.384741 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 12:53:35.384966 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 12:53:35.385363 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 12:53:35.385625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 12:53:35.386020 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.386376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.386733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.387424 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.387770 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.388094 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.388426 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.388759 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.389120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.389391 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.389723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.390061 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841644-1-iscsi {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.390396 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.390713 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.391033 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.391363 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.391679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.392010 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.392326 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.392829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.393304 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.393629 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.394112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.394306 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.394631 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.394951 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.395284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.395602 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.395938 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.396258 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.396669 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841644-1-iscsi {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.397015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.397341 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.397665 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.398092 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.398668 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.398988 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.399314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.399645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.399960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.400295 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.400622 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.400949 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.401305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.401614 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.401932 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.402248 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.403092 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.403409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.404284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.404284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.404284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.404746 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.404891 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.405256 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.405514 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.405772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.406099 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.406427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.406746 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.407066 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.407380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.407694 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.408167 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.408636 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.409138 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.409459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.409788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.410132 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.410431 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.410746 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.411095 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.411487 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.411743 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.412059 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.412408 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.412735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.413076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.413406 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.413734 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.414052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.414368 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.414681 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.415009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.415337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.415648 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.415905 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.416215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.416530 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.416855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.417193 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.417510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.417824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.418883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.419215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.419535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.419856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.420175 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.420495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.420807 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.421223 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.421544 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.421862 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.422193 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.422523 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.422842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.423159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.423474 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.423789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.424116 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.424438 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.424753 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.425248 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.425412 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.425725 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.426055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.426372 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.426687 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.427014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.427324 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.427641 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.427967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.428285 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.428602 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.428919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.429266 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.429578 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.429894 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.430210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.430533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.430834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.431160 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.431491 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.431809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.432140 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.432431 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.432960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.433337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.433641 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 12:53:35.434179 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.434274 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 12:53:35.434349 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.434430 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 12:53:35.434615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.434806 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 12:53:35.434922 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.435070 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 12:53:35.435255 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.435459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.435615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.435802 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.435914 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.440842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.441029 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.441173 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.441305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.441440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.441565 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.441690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.441811 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.441922 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.442031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.442150 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.442269 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.442386 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.442497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.442607 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.442725 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.442838 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.442954 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.443063 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.443183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841644-1-iscsi {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.443303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.443426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.443538 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.443954 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.444084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.444204 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.444321 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.444446 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.444568 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.444678 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.444795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.444907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.445059 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.445207 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.445319 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.445429 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.445562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.445686 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.445815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.445935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.446056 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.446174 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.446302 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.446413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.446539 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.446658 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.446778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.446904 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.447022 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.447139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.447364 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.447486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.447603 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.447721 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.447850 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.448086 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.448203 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.448320 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841644-1-iscsi {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.448430 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.448558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.448681 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.448792 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.448906 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.448906 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.449339 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.449565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.449694 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.449819 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.449941 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.450128 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.450250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.450369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.450490 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.450615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.450733 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.450935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.451055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.451177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.451296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.451406 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.451527 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.451638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.451753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.451940 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.452061 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.452061 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.452268 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.452385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.452502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.452624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.452734 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.452843 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.452951 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.453105 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.453276 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.453438 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.453601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.453853 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.454177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.454338 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.454497 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.454649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.454800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.454953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.455124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.455406 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.455585 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.455732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.455889 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.456040 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.456186 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.456347 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.456499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.456650 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.456802 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.456953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.457122 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.457280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.457521 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.457683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.457835 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.457990 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.458243 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.458408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.458562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.458707 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.458856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.459008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.459297 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.459462 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.459634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.459899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.460053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.460209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.460367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.460557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.460710 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.460862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.461121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.461282 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.461442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.461595 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.461783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.461941 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.462085 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.462228 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.462390 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.462535 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.462678 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.462822 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.462970 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.463246 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.463419 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.463574 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.463717 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.463952 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.464290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.464455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.464609 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.464775 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.465513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.465747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.465906 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.466051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.466203 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.466358 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.466510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.466665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.466817 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.466969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.467134 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.467290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.467442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.467688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.467848 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.468003 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.468157 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.468409 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.468567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.468712 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.468856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.469034 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.469335 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.469559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.469730 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.469907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.470132 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.470281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.470439 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.470439 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.470730 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.470730 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.471017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.471262 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.471412 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.471564 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.471720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.471881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.472024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.472182 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.472325 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.472469 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.472619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.472763 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.472917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.473097 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.473253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.473397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.473549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.473700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.473864 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.474104 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.474434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.474590 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.474744 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.474897 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.475048 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.475201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.475346 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.475508 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.475774 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.475947 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.476101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.476265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.476410 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.476564 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.476708 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.476858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.477153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.477306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.477501 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.477682 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.477909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.478059 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.478202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.478354 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.478629 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.478800 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.478954 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.479099 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.479242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.479477 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.479709 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.479883 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.480032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.480269 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.480419 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.481280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.481606 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.481760 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.481904 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.482047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.482190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.482334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.483026 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.483185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.483330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.483474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.483617 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.483771 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.483930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.484112 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.484325 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.484672 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.484832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.485049 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.485236 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.485393 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.485547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.485692 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:53:35.485836 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.485995 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.486139 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.486282 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.486436 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.486587 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.486739 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.486899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.487043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.487043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.487418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.487571 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.487723 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.487900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.487900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.488263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.488429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.488581 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.488845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.489091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.489255 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.489408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.489647 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.489877 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.490050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.490196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.490434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.490597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.490748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.490903 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.491062 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.491207 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.491357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.491519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.491733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.491889 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.492044 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.492197 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.492349 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.492492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.492635 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.492778 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.492941 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.493120 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.493274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.493427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.493571 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.493728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.493871 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.494014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.494166 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.494317 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.494468 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.494727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.494973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.494973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.495265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.495265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.495551 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.495551 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.495837 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.495997 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.496801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.496974 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.497166 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.497420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.497571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.497727 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.497878 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.498029 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.498272 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.498423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.498568 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.498719 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.498881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.499121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.499293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.499447 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.499599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.500050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.500224 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.500370 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.500618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.500776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.500921 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.501121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.501270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.501415 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.501570 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.501739 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.501956 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.502104 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.502247 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.502415 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.502562 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.502705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.502858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503002 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503145 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503297 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503441 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503583 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503999 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.503999 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.504296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.504448 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.504592 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.504828 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.504995 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.505168 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.505315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.505458 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.505601 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.505753 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.505906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.506157 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.506319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.506472 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.506625 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.506785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.506936 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.507080 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.507224 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.507393 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.507619 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.507775 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.508193 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.508435 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.508586 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.508748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.508903 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.509069 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.509321 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.509468 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.509612 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.509767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.510014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.510230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.510385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.510530 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.510769 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.510928 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.511093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.511238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.511389 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.511532 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.511683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.512487 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.512640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.512794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.512941 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.513149 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.513304 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.513529 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.513675 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.513837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.513982 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.514125 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.514278 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.514429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.514590 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.514742 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.514975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.515134 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.515290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.515434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.515577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.515738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.515882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.516025 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.516200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.516457 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.516608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.516752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.516896 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.517077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.517230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.517381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.517533 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.517773 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.517948 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.518111 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.518264 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.518436 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.518657 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.518805 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.518956 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.519110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.519263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.519519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.519685 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.519839 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.520010 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.520268 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.520496 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.520653 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.520895 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.521118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.521280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.521435 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.521580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.521731 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.521883 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.522027 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.522181 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.522324 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.522511 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.522741 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.522889 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.523041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.523195 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.523600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.523600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.523891 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.524041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.524185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.524341 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.524486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.524639 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.524789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.524933 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.525187 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.525354 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.525499 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.525651 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.525803 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.525945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.526097 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.526241 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.526391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.526646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.526807 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.526958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.527120 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.527271 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.527475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.528204 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.528353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.528497 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.528797 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.529102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.529257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.529410 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.529575 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.529845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.529845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.530145 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.530393 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.530645 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.530801 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.531056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.531207 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.531353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.531504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.531648 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.531791 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.531945 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.532120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.532264 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.532422 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.532581 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.532749 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.533010 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.533171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.533334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.533485 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.533642 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.533800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.533966 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.534119 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.534286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.534445 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.534914 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.535092 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.535364 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.535540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.535706 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.535866 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.536018 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.536180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.536331 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.536490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.536672 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.536952 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.537174 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.537338 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.537499 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.537668 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.537820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.537969 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.538129 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.538398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.538556 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.538708 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.538866 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.539055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.539316 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.539473 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.539631 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.539789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.540079 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.540236 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.540417 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.540693 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.540942 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.541215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.541375 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.541526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.541740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.541893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.541893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.542188 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.542348 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.542514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.542680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.542832 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.542832 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.543675 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.543675 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.544036 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.544193 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.544357 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.544357 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.544645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.544798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.544963 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.545166 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.545335 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.545335 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.545883 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.546036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.546196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.546347 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.546497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.546659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.546810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.546985 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.547285 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.547442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.547593 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.547744 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.547894 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.548059 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.548218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.548388 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.548642 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.548809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.548968 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.549186 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.549452 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.549610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.549762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.549965 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.550265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.550504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.550676 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.550941 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.551200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.551451 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.551619 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.551781 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.551935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.552085 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.552243 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.552403 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.552570 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.552722 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.552874 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.553052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.553052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.553356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.553356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.553682 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.553882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.554038 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.554197 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.554349 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.554509 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.554661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.554811 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.554963 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.555120 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.555279 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.555660 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.555918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.556088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.556240 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.556398 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.556558 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.556711 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.556869 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.557040 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.557199 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.557492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.557664 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.557824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.557978 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.557978 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.558287 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.558447 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.558738 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.559008 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.559166 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.559317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.559507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.559925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.560106 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.560298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.560695 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.560918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.561373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.561664 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.561867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.562032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.562198 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.562351 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.562511 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.562662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.562813 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.562970 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.563122 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.563287 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.563440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.563603 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.563754 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.563906 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.564070 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.564221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.564373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.564533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.564695 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.564855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.565047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.565206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.565365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.565528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.565698 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.568783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.569279 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.569279 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.569619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.569778 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.570058 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.570230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.570400 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.570552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.570733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.571032 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.571256 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.571926 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.572109 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.572272 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.572427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.572580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.572731 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.572963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.573267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.573517 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.573773 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.573971 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.574128 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.574885 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.575056 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.575356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.575679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.575980 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.576627 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.576874 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.577116 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.577301 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.577468 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.577621 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.577788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.578057 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.578230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.578384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.579628 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.579863 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.580105 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.580421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.580598 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.580843 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.581349 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.581578 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.582204 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.582417 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.582709 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.582945 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.583171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.583399 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.583627 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.583788 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.583949 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.584102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.584254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.584451 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.584629 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.584821 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.585015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.585201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.585394 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.585570 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.585723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.585723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.585723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.586219 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.586667 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.586899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.587069 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.587222 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.587383 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.587544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.587708 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.587873 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.588033 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.588185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.588336 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.588495 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.588663 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.588823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.589001 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.589167 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.589278 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.589375 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.589672 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.589786 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.590726 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.590935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.591139 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.591509 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.591784 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.591922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.592331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.592462 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.592682 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.592931 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.593279 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.593483 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.593680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.593869 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.594075 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.594291 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.594485 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.594676 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.594856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.595028 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.595190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.595388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.595564 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.595685 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.595806 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.595921 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.596031 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.596158 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.596272 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.596384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.596517 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.596869 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597156 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597400 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597620 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597739 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.597861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598025 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598272 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598623 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598854 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.598965 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.599076 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.599277 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.599391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.599509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.599509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.599846 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.599988 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.600131 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.600260 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.600373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.600483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.600609 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.600730 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.600842 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601386 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.601993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.602551 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.602681 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.602804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.602920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603040 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603275 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603387 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603517 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603517 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.603961 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604302 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604534 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604653 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604764 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.604881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.605010 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.605010 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.605260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.605375 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.605549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.605737 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.605934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.606148 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.606148 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.606531 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.606754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.606754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.607397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.607601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.607601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.607961 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.608154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.608358 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.608553 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.608553 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.609313 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.609533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.609720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.609923 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.609923 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.610438 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.610633 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.610818 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.610996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.611174 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.611380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.611565 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.611752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.611931 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.612299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.612808 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.612936 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.613123 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.613250 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.613403 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.613575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.613778 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.613974 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.614889 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.615009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.615009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.615627 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.615755 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.615875 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.615875 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616083 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616203 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616323 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616323 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616530 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.616868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.617242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.617242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.617242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.617242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.617689 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.617816 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.617938 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618267 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618377 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618377 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618595 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618936 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.618936 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619154 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619393 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619393 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619741 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619854 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.619964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.620082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.620082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.620415 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.620622 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.620762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.620889 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621027 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621321 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621468 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621588 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621707 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.621937 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.622059 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.622180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.622433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.622568 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.622981 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623338 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623569 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623679 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.623909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624438 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.624900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625502 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625571 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625721 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625790 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625860 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.625938 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626092 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626243 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626312 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626381 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626593 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626666 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626735 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.626953 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627030 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627170 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627456 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627553 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627707 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627777 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627863 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.627934 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628019 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628099 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628480 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628715 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628786 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628864 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.628943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.629388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.629503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.629613 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.629732 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.629854 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.629979 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630201 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630660 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630887 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.630998 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631131 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631602 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631831 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.631950 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.632062 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.632180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.632292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.632402 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.632640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.632799 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.633178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.633308 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.633421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.633547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.633668 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.633793 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.633906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634135 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634694 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634812 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.634812 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.635028 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.635140 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.635257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.635370 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.635486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.635624 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.635913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.636031 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.636143 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.636254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.636372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.636492 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.636612 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.637270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.637412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.637706 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.637845 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.637968 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638200 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638781 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.638893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639004 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639235 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639358 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639470 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639587 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639699 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639816 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.639938 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640160 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640269 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640387 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640500 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640840 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.640965 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.641123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.641245 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.641376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.641509 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.641621 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.641740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.641880 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.642009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.642134 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.642247 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.642358 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.642469 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.642580 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.643594 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.643806 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.643932 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644239 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644351 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644470 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644592 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644712 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644825 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.644935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645081 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645219 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645342 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645677 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.645907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646027 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646138 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646483 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646604 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646844 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.646962 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.647073 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.647192 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.647317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.647429 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.648570 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.648703 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.648818 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.648818 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.649176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.649317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.649447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.649569 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.649688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.649800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.649941 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650054 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650174 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650286 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650398 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650516 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650516 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.650884 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651107 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651224 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651335 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651573 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651709 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651837 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.651957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.652076 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.652186 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.652311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.652496 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.653154 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.653597 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.653852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.653969 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.654093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.654264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.654422 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.654539 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.654686 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.654853 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.655001 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.655174 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.655356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.655531 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.655831 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.656069 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.656229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.656378 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.656535 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.656683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.656906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.657247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.657412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.657562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.657718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.658202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.658419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.658624 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.658867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.659099 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.659324 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.659538 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.659802 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.660075 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.660269 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.660494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.660765 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.660972 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.661391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.661598 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.661875 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.662103 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.662292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.662496 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.662717 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.662895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.663060 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.663610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.663610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.663796 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664160 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664261 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664348 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664441 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664669 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.664868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665000 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665154 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665435 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.665994 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666090 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666090 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666263 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.666923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.667538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.668865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.669285 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.669427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.669888 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.670220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.670648 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.671230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.671801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.672392 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.672898 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.673443 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.673928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.674398 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.674879 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.675813 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.676085 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.676480 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.677156 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.677688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.678284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.678840 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.679373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.679956 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.680441 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_db.sqlalchemy.engines [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:35.680649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.680996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.681365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.681811 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.682336 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.682684 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.683294 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.683971 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.684100 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.684378 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.684730 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.685082 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.685412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.685847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.686298 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.686630 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.686960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.687290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.687632 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.687956 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.688284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.688618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.688944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.689335 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.689632 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.689959 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.690286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.690615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.690977 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.691320 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.691652 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.691987 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.692412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.692646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.692975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.693319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.693648 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.694011 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.694344 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.694648 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.694970 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.695424 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.695754 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.696093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.696421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.696747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.697130 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.697458 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.697873 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.698193 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.698427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.698771 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.699130 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.700245 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.700498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.700917 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.701394 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.701728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.702055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.702389 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.702703 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.703021 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.703338 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.703661 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.703982 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.704302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.704621 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.704940 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.705288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.705603 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.705921 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.706242 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.706557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.706872 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.707187 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.707509 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.707826 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.708143 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.708463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.708778 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.709114 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.709463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.710077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.710184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.710458 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.710783 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.711119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.711444 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.711780 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.712116 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.712447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.712770 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.713140 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.713467 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.713793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.714119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.714443 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.714767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.715749 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.716394 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.716692 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.717043 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.717391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.717727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.718067 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.718401 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.718732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.719075 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.719405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.719729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.720064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.720386 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.720710 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.721065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.721397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.721746 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.722086 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.722410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.722753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.723093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.723457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.723787 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.724148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.724491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.724820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.725175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.725500 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:53:35.725760 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 12:53:35.749918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.context [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24af8c6d-20c5-4c42-8aad-3b952e53d778(cell1) {{(pid=123410) load_cells /opt/stack/nova/nova/context.py:464}} May 13 12:53:35.750429 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_db.sqlalchemy.engines [None req-c903d186-f902-4522-aa87-689194181c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:35.754455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:53:35.756068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:53:35.756901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:53:35.758930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:53:35.771290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_db.sqlalchemy.engines [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:35.773487 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_db.sqlalchemy.engines [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:35.817455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.context [None req-c903d186-f902-4522-aa87-689194181c04 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24af8c6d-20c5-4c42-8aad-3b952e53d778(cell1) {{(pid=123409) load_cells /opt/stack/nova/nova/context.py:464}} May 13 12:53:35.822128 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c903d186-f902-4522-aa87-689194181c04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:53:35.825546 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c903d186-f902-4522-aa87-689194181c04 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:53:35.826868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c903d186-f902-4522-aa87-689194181c04 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:53:35.830015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c903d186-f902-4522-aa87-689194181c04 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:53:35.845133 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_db.sqlalchemy.engines [None req-c903d186-f902-4522-aa87-689194181c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:35.847006 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_db.sqlalchemy.engines [None req-c903d186-f902-4522-aa87-689194181c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:35.935121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_db.sqlalchemy.engines [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:36.008935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_db.sqlalchemy.engines [None req-c903d186-f902-4522-aa87-689194181c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:53:36.258783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: WARNING keystonemiddleware.auth_token [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:53:36.266644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: WARNING keystonemiddleware.auth_token [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:53:36.333990 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: WARNING keystonemiddleware.auth_token [None req-c903d186-f902-4522-aa87-689194181c04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:53:36.342125 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: WARNING keystonemiddleware.auth_token [None req-c903d186-f902-4522-aa87-689194181c04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:53:36.613925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: WARNING keystonemiddleware.auth_token [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:53:36.620237 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: WARNING keystonemiddleware.auth_token [None req-2e2d733b-6e13-469d-a6f4-cada121a458a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:53:36.626396 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0263249c0 pid: 123410 (default app) May 13 12:53:36.716882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: WARNING keystonemiddleware.auth_token [None req-c903d186-f902-4522-aa87-689194181c04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 12:53:36.723260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: WARNING keystonemiddleware.auth_token [None req-c903d186-f902-4522-aa87-689194181c04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 12:53:36.728667 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0263249c0 pid: 123409 (default app) May 13 12:54:21.465308 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-25a82afa-b5e3-45b0-afb7-d6d338e51855 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Action: 'create', calling method: .version_select at 0x7f0603ffe280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1632336857", "metadata": {"Type": "work"}}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:23.758557 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-25a82afa-b5e3-45b0-afb7-d6d338e51855 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.846106 May 13 12:54:23.760753 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Fri May 13 12:54:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3850 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 12:54:23.776942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-dbeb5f50-ad3a-47a1-ac18-a88c996d5dbb tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Calling method '.version_select at 0x7f0603e59280>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:23.947633 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-dbeb5f50-ad3a-47a1-ac18-a88c996d5dbb tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991" status: 200 len: 353 microversion: 2.1 time: 0.175875 May 13 12:54:23.956509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 2/2] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 12:54:23 2022] GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:54:24.102671 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1970608524", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "networks": [{"uuid": "b032638b-546c-4763-8f7c-e53a0e0d1071"}]}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:24.533069 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] validate_networks() for [('b032638b-546c-4763-8f7c-e53a0e0d1071', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:54:24.962674 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5c3dd22e-4c88-483e-8a9c-227152703230 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Calling method '.version_select at 0x7f0603e594c0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:25.095660 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5c3dd22e-4c88-483e-8a9c-227152703230 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991" status: 200 len: 354 microversion: 2.1 time: 0.137425 May 13 12:54:25.103586 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 3/3] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 12:54:24 2022] GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:54:25.111327 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-beb23b63-cfd2-43d9-b0a9-e739fc3a220a tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Calling method '.version_select at 0x7f0603e599d0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:25.242665 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-beb23b63-cfd2-43d9-b0a9-e739fc3a220a tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991" status: 200 len: 354 microversion: 2.1 time: 0.134725 May 13 12:54:25.243854 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 12:54:25 2022] GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:54:25.262535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fc30a337-79b9-49fa-9d5d-706fe8b3ba31 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Calling method '.version_select at 0x7f0603e550d0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:25.400171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fc30a337-79b9-49fa-9d5d-706fe8b3ba31 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991" status: 202 len: 0 microversion: 2.1 time: 0.142373 May 13 12:54:25.401284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 5/5] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 12:54:25 2022] DELETE /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:54:25.411535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e79348dc-905e-4af2-aaab-5c5cd96277b6 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Calling method '.version_select at 0x7f0603e59d30>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:25.528786 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e79348dc-905e-4af2-aaab-5c5cd96277b6 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991" status: 200 len: 353 microversion: 2.1 time: 0.121265 May 13 12:54:25.528786 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 6/6] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 12:54:25 2022] GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:54:26.050910 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:54:26.051905 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:54:26.053927 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:54:26.057019 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:54:26.057401 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:54:26.117917 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:26.118178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:26.119090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:26.119540 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:26.192293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Getting quotas for project 612784cc2dcc45b1b71ec19fc213f48f. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:54:26.202961 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Getting quotas for user 5cbe87047c574127861cf1e4944c0fff and project 612784cc2dcc45b1b71ec19fc213f48f. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:54:26.222094 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:54:26.226259 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:54:26.374163 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3f21965d-45f4-4e57-8468-aafe565f6005 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.943077 May 13 12:54:26.375974 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 1/7] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 12:54:26.388222 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4caf3e54-99c3-4725-abb5-274c22fa56ec tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:26.389214 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4caf3e54-99c3-4725-abb5-274c22fa56ec tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:26.542087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8b0ac236-76dc-4ee7-afbc-988fc8063989 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Calling method '.version_select at 0x7f0603600280>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:26.653253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4caf3e54-99c3-4725-abb5-274c22fa56ec tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:26.681294 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-8b0ac236-76dc-4ee7-afbc-988fc8063989 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] HTTP exception thrown: Volume aaee5626-2f46-4d40-84fb-701821f29991 could not be found. May 13 12:54:26.685914 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4caf3e54-99c3-4725-abb5-274c22fa56ec tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1215 microversion: 2.1 time: 0.299077 May 13 12:54:26.690760 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 7/8] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:26 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1215 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8b0ac236-76dc-4ee7-afbc-988fc8063989 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Request method failure captured: May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991 HTTP/1.1 May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflT71U6a6ZLKi1vK32ss-qKBRqRKqbrTt7JB5RqVqHxk7k9Kiizx_ZCH97kY-kdQeF0YmRKSkewOWXLXCTl7xNlM7O0au6mVhiaTeS4nGfSvGy3VfFumOaradjOhodgoBjmI5-WQ6LjMURP-E6DwXMzRANbULcz0DqPNcbEbtzdPLxw May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 8494cd6cad1a4855ac2bc0c2ebf724cf May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesGetTestJSON-640834063 May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:54:26.705744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8494cd6cad1a4855ac2bc0c2ebf724cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8494cd6cad1a4855ac2bc0c2ebf724cf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8494cd6cad1a4855ac2bc0c2ebf724cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8494cd6cad1a4855ac2bc0c2ebf724cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesGetTestJSON-640834063 May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 8494cd6cad1a4855ac2bc0c2ebf724cf May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesGetTestJSON-640834063 May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesGetTestJSON-640834063-project May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 4dad0e1d34a649bd999ecacc40b02062 May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesGetTestJSON-640834063-project May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Volume aaee5626-2f46-4d40-84fb-701821f29991 could not be found. May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'aaee5626-2f46-4d40-84fb-701821f29991'} May 13 12:54:26.706773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aaee5626-2f46-4d40-84fb-701821f29991 could not be found. (HTTP 404) (Request-ID: req-37a48f3b-19cd-4e58-a532-601a8c6cd9b8) May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:54:26.707498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 12:54:26.708293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aaee5626-2f46-4d40-84fb-701821f29991 could not be found. May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 12:54:26.709229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aaee5626-2f46-4d40-84fb-701821f29991 could not be found. May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aaee5626-2f46-4d40-84fb-701821f29991 could not be found. May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:54:26.710111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8b0ac236-76dc-4ee7-afbc-988fc8063989 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] Returning 404 to user: Volume aaee5626-2f46-4d40-84fb-701821f29991 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:54:26.712700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8b0ac236-76dc-4ee7-afbc-988fc8063989 tempest-VolumesGetTestJSON-640834063 tempest-VolumesGetTestJSON-640834063-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991" status: 404 len: 109 microversion: 2.1 time: 0.172548 May 13 12:54:26.721631 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 2/9] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 12:54:26 2022] GET /compute/v2.1/os-volumes/aaee5626-2f46-4d40-84fb-701821f29991 => generated 109 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 12:54:27.716609 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-74cdbf56-1060-4315-ab6d-3c58f56c6204 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:27.718436 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-74cdbf56-1060-4315-ab6d-3c58f56c6204 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:28.460309 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-74cdbf56-1060-4315-ab6d-3c58f56c6204 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:28.470683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-74cdbf56-1060-4315-ab6d-3c58f56c6204 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1215 microversion: 2.1 time: 0.763490 May 13 12:54:28.473595 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 8/10] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:27 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1215 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:29.491389 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:29.492704 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:29.522743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:29.525256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:29.527885 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:29.531056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:29.973586 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:30.019215 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3e61d573-5b7e-4b40-827a-1dbdf66a78fe tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1267 microversion: 2.1 time: 0.532342 May 13 12:54:30.030937 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 3/11] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:29 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1267 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:31.041322 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:31.041322 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:31.051069 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:31.051526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:31.052318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:31.052762 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:31.466326 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:31.495510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-75cabb16-c463-408a-b5c1-19df859f4da6 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1273 microversion: 2.1 time: 0.456637 May 13 12:54:31.504845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 9/12] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:31 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1273 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:32.514515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:32.516211 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:32.553778 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:32.554650 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:32.555674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:32.556408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:33.021361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:33.033231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ddaf73a8-abf7-47a6-bff3-28ebdf8ef99b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1273 microversion: 2.1 time: 0.523856 May 13 12:54:33.034148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 4/13] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:32 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1273 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:34.050166 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:34.050808 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:34.061557 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:34.062624 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:34.063426 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:34.063930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:36.394922 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:36.407986 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2603d431-9391-44df-a843-2776bb9ea0c3 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 2.358852 May 13 12:54:36.411470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 10/14] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:34 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:36.802995 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0db0fc1c-b08e-44ff-8dbe-c8ba9e5969c1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'create', calling method: .version_select at 0x7f0602c20700>, body: {"keypair": {"name": "tempest-keypair-557763016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/41tzMijMQ/GxgVttJjtTLQGZ+XRtR9reYME7TMha1z8xcJW+vl8Hdf60mrGjdMiUNiZDuTYQQCB1bPmwdzdSyOgzmvD16BL5PKX3FhTvfv7WviB02b2v/61WQVlnofA=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:36.867475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-0db0fc1c-b08e-44ff-8dbe-c8ba9e5969c1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:54:36.878092 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-0db0fc1c-b08e-44ff-8dbe-c8ba9e5969c1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for user e9eb9ff59bef4adb83fbb4c5b358280a and project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:54:37.047571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0db0fc1c-b08e-44ff-8dbe-c8ba9e5969c1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.040307 May 13 12:54:37.048845 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 5/15] 10.222.0.49 () {62 vars in 1199 bytes} [Fri May 13 12:54:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1042 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 12:54:37.432111 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:37.441158 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:37.465498 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:37.468263 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:37.469450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:37.470030 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:39.083560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-c7650a8d-ad06-428d-aa3e-9b3866191e67 req-e23f1192-7e63-4b73-b30a-4927ea5987bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10c17e5-f9fb-4451-bb6a-7b1184b89c69", "tag": "10edcfdf-27bf-47e2-bc00-13c44bd9924a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:39.116776 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c7650a8d-ad06-428d-aa3e-9b3866191e67 req-e23f1192-7e63-4b73-b30a-4927ea5987bd service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:39.136054 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c7650a8d-ad06-428d-aa3e-9b3866191e67 req-e23f1192-7e63-4b73-b30a-4927ea5987bd service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:39.193128 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-c7650a8d-ad06-428d-aa3e-9b3866191e67 req-e23f1192-7e63-4b73-b30a-4927ea5987bd service nova] Creating event network-changed:10edcfdf-27bf-47e2-bc00-13c44bd9924a for instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 on hv-cinder-84164 May 13 12:54:39.193679 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c7650a8d-ad06-428d-aa3e-9b3866191e67 req-e23f1192-7e63-4b73-b30a-4927ea5987bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=123409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 12:54:39.198392 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0c84e26-d093-4ef1-b352-844cc68042f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:39.199454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0c84e26-d093-4ef1-b352-844cc68042f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:39.200913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0c84e26-d093-4ef1-b352-844cc68042f4 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:39.201381 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0c84e26-d093-4ef1-b352-844cc68042f4 None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:39.224776 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.compute.rpcapi [None req-d0c84e26-d093-4ef1-b352-844cc68042f4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 12:54:39.226025 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0c84e26-d093-4ef1-b352-844cc68042f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 12:54:39.265625 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d0c84e26-d093-4ef1-b352-844cc68042f4 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369273 May 13 12:54:39.268220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 6/16] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:54:39.581170 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:39.618736 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-bff13c44-bd2d-49df-92bf-07f6ae6f4d87 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 2.188744 May 13 12:54:39.625031 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 11/17] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:37 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:40.643817 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:40.644539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:40.659826 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:40.661284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:40.661284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:40.662084 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:41.971548 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:42.002592 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f0709422-010d-47fa-b17d-45b4c85c5fe4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 1.363120 May 13 12:54:42.005951 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 7/18] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:40 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:43.023097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:43.023742 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:43.044398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:43.044938 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:43.045993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:43.046733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:44.567345 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:44.598729 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c9bab051-91a3-4da4-ae4e-6229de269818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 1.577640 May 13 12:54:44.604315 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 12/19] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:43 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:45.620147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:45.622573 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:45.633855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:45.638507 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:45.639789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:45.640844 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:45.843018 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-17477a6f-9da3-46f1-a99b-7cc4aee8c49f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: .version_select at 0x7f0602c363a0>, body: {"keypair": {"name": "tempest-keypair-1712393787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB55sm1uoBUj5BQ3UoLYduq2b6DJRHcd2gnryntp75r4oa5r0hfYTKyZCtxmDFAEWbOerm8gsba4RBHVQtKtRXmLSanmXNxccxPI9/Mnfd8oxuHNoe3PHsnV4Q9mM5/qeQ=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:45.890158 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-17477a6f-9da3-46f1-a99b-7cc4aee8c49f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:54:45.902707 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-17477a6f-9da3-46f1-a99b-7cc4aee8c49f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:54:45.953215 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-17477a6f-9da3-46f1-a99b-7cc4aee8c49f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.755796 May 13 12:54:45.954841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 8/20] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 12:54:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:54:46.673698 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2038196285", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2600954f-368e-4b9b-9fca-a1e49f9c5d94"}], "security_groups": [{"name": "tempest-securitygroup--1388504883"}], "key_name": "tempest-keypair-557763016", "user_data": "}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:46.762299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:46.779190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5e051eea-1afc-49f1-918a-dc7a7ce95818 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 1.160912 May 13 12:54:46.794474 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 13/21] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:45 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:47.193448 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] validate_networks() for [('2600954f-368e-4b9b-9fca-a1e49f9c5d94', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:54:47.801955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:47.804389 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:47.819303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:47.821494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:47.823520 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:47.825106 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:48.107308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:54:48.107736 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:54:48.108213 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:54:48.108798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:54:48.109392 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:54:48.119546 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:48.120475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:48.122111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:48.122875 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:48.176270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:54:48.188176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for user e9eb9ff59bef4adb83fbb4c5b358280a and project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:54:48.225949 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:54:48.234257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:54:48.365359 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-41ad5248-439a-45a3-b9db-c361ea1b88ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.696720 May 13 12:54:48.367240 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 9/22] 10.222.0.49 () {62 vars in 1187 bytes} [Fri May 13 12:54:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 12:54:48.483535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:48.491992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e4a7ba08-cf3b-45a8-ba3d-bfab7e2ab77f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 0.695017 May 13 12:54:48.494998 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 14/23] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:47 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:54:48.502398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-28b3125f-9970-4247-ae25-479d9a79a2b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:48.518053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-28b3125f-9970-4247-ae25-479d9a79a2b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:48.765488 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-28b3125f-9970-4247-ae25-479d9a79a2b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:48.779396 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-28b3125f-9970-4247-ae25-479d9a79a2b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:48.780934 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-28b3125f-9970-4247-ae25-479d9a79a2b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:48.787253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-28b3125f-9970-4247-ae25-479d9a79a2b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1281 microversion: 2.20 time: 0.288723 May 13 12:54:48.790029 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 15/24] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:54:48 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:54:48.899753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2061642148", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:48.985426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] validate_networks() for [('f576fff5-2fa1-4591-9247-28b4216fb188', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:54:49.522204 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:49.523232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:49.557569 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:49.558639 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:49.563666 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:49.564139 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:50.494158 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:50.520070 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-cb1cf1a5-0cbb-41fa-8e27-8601de323b1a tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 1.008612 May 13 12:54:50.524426 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 16/25] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:49 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:50.540287 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:50.540916 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:50.599015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:50.599015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:50.605639 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:50.609738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:50.823625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:50.852252 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:50.859874 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:50.868740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ad078442-e1b6-4c64-818d-8c2669af8fa4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1277 microversion: 2.20 time: 0.343031 May 13 12:54:50.869714 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 17/26] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:54:50 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:54:50.934564 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:54:50.935585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:54:50.936404 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:54:50.936969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:54:50.937573 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:54:50.967485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:50.969586 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:50.972497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:50.972907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:51.023682 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:54:51.035749 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for user fbad87a0396f4deb92f4da676af8bfdb and project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:54:51.065774 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:54:51.068273 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:54:51.197134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1aa045f1-bc8f-4dbe-ab4e-b15db5aa74c5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.828349 May 13 12:54:51.197807 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 10/27] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:54:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 12:54:51.209121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-eef1527a-a50d-485b-8ce2-117231b61124 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:51.209762 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-eef1527a-a50d-485b-8ce2-117231b61124 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:51.540816 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:51.541404 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:51.559557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:51.560012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:51.560841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:51.561465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:51.580842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-eef1527a-a50d-485b-8ce2-117231b61124 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:51.682379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-eef1527a-a50d-485b-8ce2-117231b61124 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1222 microversion: 2.1 time: 0.477648 May 13 12:54:51.690989 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 18/28] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:51 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1222 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:51.905243 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:51.908246 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:51.932903 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:51.934134 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:51.935462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:51.938900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:52.127315 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:52.149458 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:52.159623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:52.163076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-05248e1a-19e3-4bd0-9c83-542958606ffb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1339 microversion: 2.20 time: 0.278093 May 13 12:54:52.182552 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 19/29] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:54:51 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:54:52.463860 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-130853680", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:52.613497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:52.641521 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2b9542f6-7f75-4a7d-b18c-89439f663e55 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 1.099745 May 13 12:54:52.644751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 11/30] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:51 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:54:52.679203 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] validate_networks() for [('f576fff5-2fa1-4591-9247-28b4216fb188', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:54:53.197965 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:53.200950 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:53.222737 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:53.223464 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:53.224489 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:53.225230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:53.644251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:53.660760 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:53.671935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:53.675780 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1373fc92-298c-46a8-bdf9-f4200e1a472d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1339 microversion: 2.20 time: 0.486190 May 13 12:54:53.679185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 12/31] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:54:53 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1339 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:54:53.694022 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:53.701620 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:53.723125 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:53.723477 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:53.731144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:53.733243 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:54.119340 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:54.134397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c75deed9-224e-4a21-9ad4-5e686dabff50 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 0.449916 May 13 12:54:54.140017 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 13/32] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:53 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:54.150392 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1151629783", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1c41e28-5d16-459f-865e-9320359228db"}], "security_groups": [{"name": "tempest-securitygroup--137629257"}], "key_name": "tempest-keypair-1712393787", "user_data": "}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:54.575984 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] validate_networks() for [('f1c41e28-5d16-459f-865e-9320359228db', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:54:55.773384 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:54:55.774202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:54:55.774349 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:54:55.774767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:54:55.775422 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:54:55.798881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:55.800944 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:55.803244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:55.812084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:55.892325 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:54:55.908235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for user fbad87a0396f4deb92f4da676af8bfdb and project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:54:55.938912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:54:55.942036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:54:56.113407 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-37b80a69-710a-48d5-9996-eb07d5f3a6d5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.656694 May 13 12:54:56.114492 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 20/33] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:54:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 12:54:56.121885 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:56.122503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:56.139244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:56.139973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:56.140946 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:56.142861 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:56.269331 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:54:56.269768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:54:56.270355 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:54:56.270984 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:54:56.271810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:54:56.292320 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:56.294782 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:56.295842 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:56.297503 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:56.366256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:54:56.373050 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:54:56.413893 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:54:56.422325 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:54:56.577159 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-731cea66-07eb-4ac8-91e1-e77b95bfe7c2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.434041 May 13 12:54:56.586281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 14/34] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:54:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 12:54:56.600123 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:56.602319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:56.612265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:56.612733 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:56.613635 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:56.614011 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:56.684661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:56.695055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:56.698087 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:56.700359 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6bb7e4b4-a951-4b6d-8b26-541b769bd903 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.584138 May 13 12:54:56.701878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 21/35] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:54:56 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:54:57.177625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-7672ec07-2dd5-498b-a810-370c96464a4a req-7a251eff-d099-4c6c-84e3-dce1d58c86b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10c17e5-f9fb-4451-bb6a-7b1184b89c69", "name": "network-vif-plugged", "status": "completed", "tag": "10edcfdf-27bf-47e2-bc00-13c44bd9924a"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:57.203453 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-7672ec07-2dd5-498b-a810-370c96464a4a req-7a251eff-d099-4c6c-84e3-dce1d58c86b4 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.204199 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-7672ec07-2dd5-498b-a810-370c96464a4a req-7a251eff-d099-4c6c-84e3-dce1d58c86b4 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.232468 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-7672ec07-2dd5-498b-a810-370c96464a4a req-7a251eff-d099-4c6c-84e3-dce1d58c86b4 service nova] Creating event network-vif-plugged:10edcfdf-27bf-47e2-bc00-13c44bd9924a for instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 on hv-cinder-84164 May 13 12:54:57.233459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-7672ec07-2dd5-498b-a810-370c96464a4a req-7a251eff-d099-4c6c-84e3-dce1d58c86b4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 12:54:57.235248 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1526a343-f57f-46c6-a713-d8c5fdd4cc7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.235776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1526a343-f57f-46c6-a713-d8c5fdd4cc7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.236655 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1526a343-f57f-46c6-a713-d8c5fdd4cc7d None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.240076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1526a343-f57f-46c6-a713-d8c5fdd4cc7d None None] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.250499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.compute.rpcapi [None req-1526a343-f57f-46c6-a713-d8c5fdd4cc7d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 12:54:57.251406 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1526a343-f57f-46c6-a713-d8c5fdd4cc7d None None] Releasing lock "compute-rpcapi-router" {{(pid=123410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 12:54:57.288486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1526a343-f57f-46c6-a713-d8c5fdd4cc7d None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.582486 May 13 12:54:57.290894 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 22/36] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:54:57.306642 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:57.309189 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:57.325463 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.326967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.330194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.330932 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.414843 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:57.427066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dca7f27f-5992-497f-9cf8-ea2116960201 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 0.838627 May 13 12:54:57.428230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 15/37] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:56 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:57.446104 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e9d50ac1-8fc1-42a9-a9a2-a2bd0b2e5e96 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:57.450396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e9d50ac1-8fc1-42a9-a9a2-a2bd0b2e5e96 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:57.452364 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:57.462133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c5a22af0-9ce8-41b3-814d-fc5ccb697294 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1225 microversion: 2.1 time: 0.168394 May 13 12:54:57.463126 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 23/38] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:57 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:57.469305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-4be73b8c-65d6-4b1d-a0d1-c56f8a5ed1dd req-5bfe987b-5ea7-4e9e-8299-6cb13d460ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83873f65-ba42-4536-9af6-4aff1db77bb4", "tag": "312207b7-e73e-4ced-8336-af184bb733a6"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:54:57.481643 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-4be73b8c-65d6-4b1d-a0d1-c56f8a5ed1dd req-5bfe987b-5ea7-4e9e-8299-6cb13d460ccd service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.482411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-4be73b8c-65d6-4b1d-a0d1-c56f8a5ed1dd req-5bfe987b-5ea7-4e9e-8299-6cb13d460ccd service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.497929 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-4be73b8c-65d6-4b1d-a0d1-c56f8a5ed1dd req-5bfe987b-5ea7-4e9e-8299-6cb13d460ccd service nova] Creating event network-changed:312207b7-e73e-4ced-8336-af184bb733a6 for instance 83873f65-ba42-4536-9af6-4aff1db77bb4 on hv-cinder-84164 May 13 12:54:57.504580 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-4be73b8c-65d6-4b1d-a0d1-c56f8a5ed1dd req-5bfe987b-5ea7-4e9e-8299-6cb13d460ccd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039893 May 13 12:54:57.506050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 24/39] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:54:57.566210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e9d50ac1-8fc1-42a9-a9a2-a2bd0b2e5e96 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:57.579201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e9d50ac1-8fc1-42a9-a9a2-a2bd0b2e5e96 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1242 microversion: 2.1 time: 0.149672 May 13 12:54:57.580243 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 16/40] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:57 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1242 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:57.723220 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:57.724070 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:57.731837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.732696 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.733750 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:57.734398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:57.968930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:57.979274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:57.981931 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:57.983747 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4d0e6878-19da-4d62-bbe5-05ed88810798 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.268370 May 13 12:54:57.984348 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 25/41] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:54:57 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:54:58.445851 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:58.447166 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:58.457283 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:58.457751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:58.458560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:58.461982 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:58.481794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:58.483330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:58.490264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:58.491388 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:58.493142 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:58.493917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:58.780588 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:58.795501 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c61d3a06-36ba-472f-b24a-7fdf1c863d70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1225 microversion: 2.1 time: 0.319437 May 13 12:54:58.806644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 26/42] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:58 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1225 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:58.814539 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:58.815641 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:58.817698 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:58.826656 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dc5890a9-776e-496c-9cf7-928ee9c2aa58 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 0.384564 May 13 12:54:58.827298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:58.828855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:58.830174 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:58.830423 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 17/43] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:58 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:58.831427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:59.003904 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:59.004527 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:59.010643 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:59.018533 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:59.019389 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:59.019839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:59.047957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:59.056067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2b2a6b72-ff76-4970-bdd7-2d0e878157d6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1294 microversion: 2.1 time: 0.246824 May 13 12:54:59.059024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 27/44] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:58 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1294 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:54:59.355701 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:59.365310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:59.374050 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:54:59.379521 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f538ce8f-073a-49a2-b9b1-9d0ff3259134 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.382048 May 13 12:54:59.380290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 18/45] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:54:58 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:54:59.813539 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:59.814823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:59.821908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:59.822610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:59.823573 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:59.824689 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:59.848499 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:54:59.850537 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:54:59.868804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:59.873573 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:54:59.874814 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:54:59.878066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:00.041061 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:00.049511 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-13b26f06-edc9-4cff-a578-ff36de9fcad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1281 microversion: 2.1 time: 0.240376 May 13 12:55:00.050692 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 28/46] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:59 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:00.076371 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:00.077134 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:00.086469 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:00.087200 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:00.088415 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:00.089145 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:00.290958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:00.302966 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e449bc2f-bde4-4cce-8e76-1933c67cbcdd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1312 microversion: 2.1 time: 0.233526 May 13 12:55:00.304158 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 29/47] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:00 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:00.342415 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:00.356717 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ff95f95f-ad81-4d1f-8ec2-f06c430a9f9e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 0.511259 May 13 12:55:00.358973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 19/48] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:54:59 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:00.398633 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:00.399255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:00.410228 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:00.410694 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:00.411757 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:00.412203 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:00.600897 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-defc48b9-dd30-422c-a0e1-17d5a949c8cf req-954ea106-5a36-49c6-b346-d76c53eadcef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ff36f5-3afb-4239-b817-663ac72e599f", "tag": "08d00a85-0887-4227-be00-65bf3e7c0381"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:00.620071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-defc48b9-dd30-422c-a0e1-17d5a949c8cf req-954ea106-5a36-49c6-b346-d76c53eadcef service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:00.621927 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-defc48b9-dd30-422c-a0e1-17d5a949c8cf req-954ea106-5a36-49c6-b346-d76c53eadcef service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:00.648454 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-defc48b9-dd30-422c-a0e1-17d5a949c8cf req-954ea106-5a36-49c6-b346-d76c53eadcef service nova] Creating event network-changed:08d00a85-0887-4227-be00-65bf3e7c0381 for instance b9ff36f5-3afb-4239-b817-663ac72e599f on hv-cinder-84164 May 13 12:55:00.656273 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-defc48b9-dd30-422c-a0e1-17d5a949c8cf req-954ea106-5a36-49c6-b346-d76c53eadcef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350380 May 13 12:55:00.658096 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 30/49] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:01.070203 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:01.071089 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:01.090866 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:01.093238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:01.095698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:01.096580 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:01.165304 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:01.174975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:01.176809 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:01.178128 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a25e0805-cc52-4d33-bf07-103d835b4c88 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.784014 May 13 12:55:01.188937 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 20/50] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:00 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:55:01.286182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:01.299973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c245f957-63ee-4a52-afcf-af673c5044ae tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1279 microversion: 2.1 time: 0.233612 May 13 12:55:01.302039 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 31/51] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:01 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:01.323057 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:01.324850 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:01.332184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:01.332867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:01.333916 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:01.334506 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:01.375068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:01.375942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:01.383456 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:01.384183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:01.385163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:01.385744 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:01.491341 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:01.504771 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e1d2df31-66c7-40cd-905e-ae8db4c11c58 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1300 microversion: 2.1 time: 0.186819 May 13 12:55:01.507981 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 21/52] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:01 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:01.830985 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:01.845641 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-479f280d-7198-48b3-b9a4-464bf2b77f88 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1315 microversion: 2.1 time: 0.474979 May 13 12:55:01.847504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 32/53] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:01 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:02.204512 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:02.205315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:02.215409 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:02.222221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:02.223585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:02.224374 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:02.322142 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:02.328037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:02.348785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:02.349562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:02.350536 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:02.351133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:02.752933 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:02.760374 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7e13694d-3b0c-4bc5-b4d5-f851bb78b4c8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.442936 May 13 12:55:02.765454 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 33/54] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:02 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:02.781835 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:02.782758 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:02.791618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:02.792318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:02.794777 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:02.796809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:02.985736 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:02.997361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:03.002945 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:03.005601 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dbd87bb9-bf8d-44a6-af34-9733ff05716b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.809737 May 13 12:55:03.006753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 22/55] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:02 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:03.017859 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:03.021753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:03.045379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:03.047087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:03.048148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:03.048708 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:03.148102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:03.160459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2f40d637-68ea-4a25-8901-3a7eedea57ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.393701 May 13 12:55:03.161799 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 34/56] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:02 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:03.398083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:03.412559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5b2b099f-ccc4-4640-8dde-f143c17e5fff tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1501 microversion: 2.1 time: 0.403506 May 13 12:55:03.414239 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 23/57] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:03 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1501 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:03.781397 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:03.782837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:03.794342 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:03.795526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:03.796945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:03.800284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:04.003454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-365095ef-20cc-48a8-981a-a2ef1ec09ae4 req-40c01b50-4fda-4322-ba25-8aeeb74c5f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2825cd-1b9d-4434-bf94-ebf3f6688015", "tag": "2f8c0546-7559-4827-9638-ab93068addc3"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:04.021185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-365095ef-20cc-48a8-981a-a2ef1ec09ae4 req-40c01b50-4fda-4322-ba25-8aeeb74c5f58 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:04.021639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-365095ef-20cc-48a8-981a-a2ef1ec09ae4 req-40c01b50-4fda-4322-ba25-8aeeb74c5f58 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:04.061295 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-365095ef-20cc-48a8-981a-a2ef1ec09ae4 req-40c01b50-4fda-4322-ba25-8aeeb74c5f58 service nova] Creating event network-changed:2f8c0546-7559-4827-9638-ab93068addc3 for instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 on hv-cinder-84164 May 13 12:55:04.070347 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-365095ef-20cc-48a8-981a-a2ef1ec09ae4 req-40c01b50-4fda-4322-ba25-8aeeb74c5f58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071278 May 13 12:55:04.071279 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 24/58] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:55:04.079185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:04.080066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:04.086939 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:04.088279 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:04.089455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:04.090116 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:04.133117 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:04.143528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2782d2f6-e8a2-40a0-b672-c3320907be77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.368104 May 13 12:55:04.144130 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 35/59] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:03 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:04.179148 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:04.179955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:04.189484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:04.189948 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:04.191196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:04.191638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:04.285535 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:04.295847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:04.297527 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:04.298701 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-101ccc67-0b5e-4367-98f1-7529b0aa0061 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.225904 May 13 12:55:04.299278 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 25/60] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:04 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:04.551185 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:04.562411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f8d8a822-665f-4b29-bd59-f1e68187d652 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.387238 May 13 12:55:04.563636 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 36/61] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:04 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:05.161120 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:05.161752 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:05.174997 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:05.175384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:05.178454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:05.180575 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:05.319048 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:05.320247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:05.332575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:05.333277 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:05.334295 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:05.335177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:05.475779 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:05.483861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e26786b1-0de9-4cf3-a7b1-58daac55bece tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.326951 May 13 12:55:05.493456 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 26/62] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:05 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:05.499615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-cda81a44-952a-4dec-8a58-3397109e254a req-f0099e80-3a0c-47ae-b744-4a03f9f07493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34789621-2e0a-4fef-8268-7703885edac6", "tag": "99a73876-f6c7-452e-b541-5ee509349a0a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:05.509542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-cda81a44-952a-4dec-8a58-3397109e254a req-f0099e80-3a0c-47ae-b744-4a03f9f07493 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:05.510201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-cda81a44-952a-4dec-8a58-3397109e254a req-f0099e80-3a0c-47ae-b744-4a03f9f07493 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:05.524948 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-cda81a44-952a-4dec-8a58-3397109e254a req-f0099e80-3a0c-47ae-b744-4a03f9f07493 service nova] Creating event network-changed:99a73876-f6c7-452e-b541-5ee509349a0a for instance 34789621-2e0a-4fef-8268-7703885edac6 on hv-cinder-84164 May 13 12:55:05.537042 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-cda81a44-952a-4dec-8a58-3397109e254a req-f0099e80-3a0c-47ae-b744-4a03f9f07493 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041465 May 13 12:55:05.537923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 27/63] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:05.559798 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:05.570168 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:05.572563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:05.574949 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b97f6a82-c99f-47f6-a99b-8f17c5e50bbe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.261342 May 13 12:55:05.575523 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 37/64] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:05 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:05.589793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:05.590755 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:05.597223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:05.597687 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:05.598502 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:05.598922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:05.751512 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:05.759371 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ecbdd047-0ffa-4d39-80a6-22255ec6c97e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.183757 May 13 12:55:05.760006 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 28/65] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:05 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:06.500633 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:06.501080 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:06.506932 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:06.507661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:06.508569 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:06.509101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:06.594608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:06.595222 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:06.604067 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:06.604738 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:06.606224 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:06.607732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:06.653074 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:06.661547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5f053b54-0115-4053-900e-a3fbf2a0dfb5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.165550 May 13 12:55:06.662434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 38/66] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:06 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:06.762097 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:06.771690 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:06.774739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:06.776490 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3b3d28f0-05c6-42ee-b9a1-3f3b86f228ad tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.187659 May 13 12:55:06.778541 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 29/67] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:06 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:06.788155 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:06.788897 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:06.797331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:06.797855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:06.798824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:06.799439 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:06.935983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:06.943216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6d50eae3-828a-457d-9bc0-ee58d4c8325b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.171131 May 13 12:55:06.943787 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 39/68] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:06 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:07.679759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:07.680506 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:07.691102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:07.691588 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:07.692349 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:07.692779 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:07.796729 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:07.797374 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:07.808908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:07.810625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:07.812184 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:07.826523 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:08.077097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:08.090588 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:08.097887 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:08.101983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:08.103158 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ac7c4483-094c-484c-b6a1-0eb3ffbb600d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.311428 May 13 12:55:08.103930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 40/69] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:07 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:08.116454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e78570d3-9fad-43d6-8539-590cbc6605e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.441224 May 13 12:55:08.117093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 30/70] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:07 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:08.120439 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:08.121807 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:08.136998 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:08.137804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:08.140949 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:08.144589 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:08.310248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-26d6cb82-f0e7-496a-9ce3-71c484fbab78 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8337fb0-82e3-4a79-ac7b-269423364bbe"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:08.316187 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-26d6cb82-f0e7-496a-9ce3-71c484fbab78 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:08.327752 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26d6cb82-f0e7-496a-9ce3-71c484fbab78 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:08.328457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26d6cb82-f0e7-496a-9ce3-71c484fbab78 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:08.329808 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26d6cb82-f0e7-496a-9ce3-71c484fbab78 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:08.334524 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26d6cb82-f0e7-496a-9ce3-71c484fbab78 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:08.470846 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:08.482271 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ade46e8f-4b6f-410d-893c-73d9dee4f5d4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.377123 May 13 12:55:08.493135 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 41/71] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:08 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:09.121689 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:09.122447 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:09.139818 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:09.140596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:09.141704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:09.142576 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:09.342420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:09.350399 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:09.352117 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:09.353434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ebf7691a-f1de-4dce-b2e4-a9ee5ff1dc44 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.236150 May 13 12:55:09.353988 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 42/72] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:09 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:55:09.358446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:09.358989 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:09.365555 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:09.366017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:09.366796 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:09.367239 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:09.521593 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:09.529971 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-57f97008-59a7-4604-af9d-84b86c17981d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.174983 May 13 12:55:09.530553 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 43/73] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:09 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:09.535328 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:09.536133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:09.543805 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:09.544259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:09.545062 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:09.545503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:09.683491 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:09.692165 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-962f0409-ffb6-4f40-8400-95d921d5721f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.160369 May 13 12:55:09.692728 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 44/74] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:09 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:09.707489 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-e7706f50-b1f5-4200-90c5-1b716adde4e7 req-778cab1a-f145-499f-abfc-6638d4b618ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ff36f5-3afb-4239-b817-663ac72e599f", "name": "network-vif-plugged", "status": "completed", "tag": "08d00a85-0887-4227-be00-65bf3e7c0381"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:09.716064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e7706f50-b1f5-4200-90c5-1b716adde4e7 req-778cab1a-f145-499f-abfc-6638d4b618ab service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:09.716711 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e7706f50-b1f5-4200-90c5-1b716adde4e7 req-778cab1a-f145-499f-abfc-6638d4b618ab service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:09.728075 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-e7706f50-b1f5-4200-90c5-1b716adde4e7 req-778cab1a-f145-499f-abfc-6638d4b618ab service nova] Creating event network-vif-plugged:08d00a85-0887-4227-be00-65bf3e7c0381 for instance b9ff36f5-3afb-4239-b817-663ac72e599f on hv-cinder-84164 May 13 12:55:09.733648 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-e7706f50-b1f5-4200-90c5-1b716adde4e7 req-778cab1a-f145-499f-abfc-6638d4b618ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029663 May 13 12:55:09.734543 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 45/75] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:10.374504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:10.375861 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:10.383262 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:10.383891 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:10.384668 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:10.385131 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:10.555536 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:10.579253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:10.580761 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:10.582644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7005f390-c46d-4434-b700-a6a1987f2975 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.213103 May 13 12:55:10.583409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 46/76] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:10 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:10.588172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:10.588855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:10.599123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:10.599858 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:10.601130 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:10.601666 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:10.764140 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:10.772535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3720ef77-8fc3-430b-ac99-2b4cec8623fb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.187880 May 13 12:55:10.773257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 47/77] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:10 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:10.779076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:10.780101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:10.787868 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:10.788598 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:10.789681 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:10.790850 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:10.996118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-26d6cb82-f0e7-496a-9ce3-71c484fbab78 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "POST /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.691073 May 13 12:55:10.997944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 31/78] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:55:08 2022] POST /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69/os-volume_attachments => generated 194 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:55:11.061608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:11.070771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1407d2a8-1469-4a2b-9603-85cb4dce7200 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.296222 May 13 12:55:11.072318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 48/79] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:10 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:11.606056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:11.607346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:11.616567 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:11.617319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:11.618259 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:11.618759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:11.752277 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-1aacc963-826f-49d9-83d0-18a472da46bb req-d58e718f-f4a4-4a44-b25e-ed3ecdef7ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83873f65-ba42-4536-9af6-4aff1db77bb4", "name": "network-vif-plugged", "status": "completed", "tag": "312207b7-e73e-4ced-8336-af184bb733a6"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:11.762106 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-1aacc963-826f-49d9-83d0-18a472da46bb req-d58e718f-f4a4-4a44-b25e-ed3ecdef7ff2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:11.762641 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-1aacc963-826f-49d9-83d0-18a472da46bb req-d58e718f-f4a4-4a44-b25e-ed3ecdef7ff2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:11.774223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:11.774956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-1aacc963-826f-49d9-83d0-18a472da46bb req-d58e718f-f4a4-4a44-b25e-ed3ecdef7ff2 service nova] Creating event network-vif-plugged:312207b7-e73e-4ced-8336-af184bb733a6 for instance 83873f65-ba42-4536-9af6-4aff1db77bb4 on hv-cinder-84164 May 13 12:55:11.781336 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-1aacc963-826f-49d9-83d0-18a472da46bb req-d58e718f-f4a4-4a44-b25e-ed3ecdef7ff2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032665 May 13 12:55:11.782112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 49/80] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:55:11.788095 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:11.790201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:11.790985 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:11.791688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:11.791809 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9126d5db-3466-4f2c-bc52-461707f48a62 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.191464 May 13 12:55:11.798161 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:11.798592 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:11.799536 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:11.799974 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:11.803269 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 32/81] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:11 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:12.011679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:12.024251 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0f95c909-b57e-4244-b667-47de88e84e50 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.237288 May 13 12:55:12.025443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 50/82] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:11 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:12.090789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:12.091403 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:12.100472 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:12.101587 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:12.103270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:12.103848 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:12.273846 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:12.283120 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3fef7bb3-22d1-45bc-81c4-8925c596614b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.197032 May 13 12:55:12.283800 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 33/83] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:12 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:12.811470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:12.812277 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:12.818565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:12.819141 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:12.820020 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:12.820673 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:13.045745 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:13.046257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:13.052673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:13.053284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:13.054052 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:13.054491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:13.055783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:13.065655 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:13.067517 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:13.070058 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-feeb7d11-1f15-44be-b21f-8cb24eb5ceeb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.263106 May 13 12:55:13.072226 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 51/84] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:12 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:13.225892 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:13.234160 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d5b4577a-f4a1-4bec-a67a-7761c96ed376 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.192127 May 13 12:55:13.234970 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 34/85] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:13 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:13.300870 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:13.301511 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:13.315381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:13.315870 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:13.316661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:13.317673 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:13.537016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:13.547640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a8e1dc76-2689-4529-ad60-2fed9214e8a1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.248846 May 13 12:55:13.559286 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 52/86] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:13 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:14.092538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:14.093442 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:14.100459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:14.100898 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:14.101881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:14.102316 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:14.253875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:14.254491 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:14.262107 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:14.263334 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:14.264271 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:14.264898 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:14.268886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:14.281814 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:14.284678 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:14.286747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2fb38e33-fbe1-4435-9630-a31f8c5e3d7a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1407 microversion: 2.20 time: 0.198626 May 13 12:55:14.299844 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 35/87] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:14 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:55:14.446819 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:14.455067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fdcfd775-12c3-4985-ab99-40bcb4385fc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.206222 May 13 12:55:14.455477 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 53/88] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:14 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:14.575598 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:14.576529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:14.582309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:14.582764 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:14.583532 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:14.583959 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:14.761919 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:14.771704 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a42cdbef-d41a-46cd-a92e-ba87fb159a09 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.200053 May 13 12:55:14.772501 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 36/89] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:14 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:15.324782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:15.325576 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:15.332566 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.333312 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:15.334138 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.334581 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:15.471690 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:15.472316 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:15.478864 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.483363 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:15.484549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.488556 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:15.517296 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:15.528741 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:15.530703 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:15.533616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e5ce4a30-f4a4-492b-b9fe-baa7faa6d125 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1599 microversion: 2.20 time: 0.213795 May 13 12:55:15.534783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 54/90] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:55:15 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:55:15.554620 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-21cfb3cc-744e-4aeb-8fb1-5f0b2d226d0b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:15.555121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-21cfb3cc-744e-4aeb-8fb1-5f0b2d226d0b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:15.563062 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-21cfb3cc-744e-4aeb-8fb1-5f0b2d226d0b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.563788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-21cfb3cc-744e-4aeb-8fb1-5f0b2d226d0b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:15.564613 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-21cfb3cc-744e-4aeb-8fb1-5f0b2d226d0b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.565077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-21cfb3cc-744e-4aeb-8fb1-5f0b2d226d0b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:15.711954 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-21cfb3cc-744e-4aeb-8fb1-5f0b2d226d0b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.162441 May 13 12:55:15.712796 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 55/91] 10.222.0.49 () {60 vars in 1315 bytes} [Fri May 13 12:55:15 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 12:55:15.730960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:15.741809 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-455d23c0-d016-4fab-ab0c-c62588484091 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.273249 May 13 12:55:15.751791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 37/92] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:15 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:15.799369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:15.799369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:15.799369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.799369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:15.799973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:15.800203 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:16.124087 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:16.135892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-18f1753a-1e3e-494b-acba-a29b9d46f9d7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.348096 May 13 12:55:16.137433 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 56/93] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:15 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:16.356826 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-7c0d3cb8-b7f1-4a72-bf85-9b9202bac1a3 req-961bcfc7-e8f0-4f83-84be-ee4ffc9fa46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34789621-2e0a-4fef-8268-7703885edac6", "name": "network-vif-plugged", "status": "completed", "tag": "99a73876-f6c7-452e-b541-5ee509349a0a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:16.366317 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7c0d3cb8-b7f1-4a72-bf85-9b9202bac1a3 req-961bcfc7-e8f0-4f83-84be-ee4ffc9fa46b service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:16.367122 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7c0d3cb8-b7f1-4a72-bf85-9b9202bac1a3 req-961bcfc7-e8f0-4f83-84be-ee4ffc9fa46b service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:16.381325 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-7c0d3cb8-b7f1-4a72-bf85-9b9202bac1a3 req-961bcfc7-e8f0-4f83-84be-ee4ffc9fa46b service nova] Creating event network-vif-plugged:99a73876-f6c7-452e-b541-5ee509349a0a for instance 34789621-2e0a-4fef-8268-7703885edac6 on hv-cinder-84164 May 13 12:55:16.390790 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-7c0d3cb8-b7f1-4a72-bf85-9b9202bac1a3 req-961bcfc7-e8f0-4f83-84be-ee4ffc9fa46b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037988 May 13 12:55:16.391512 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 38/94] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:16.758571 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:16.759192 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:16.767230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:16.767961 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:16.769258 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:16.769931 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:17.154677 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:17.155551 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:17.169070 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:17.171569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:17.172703 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:17.174605 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:17.350221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:17.358388 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8ddb1f0a-ae51-4ffe-aa8f-04d09a9d08f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.603639 May 13 12:55:17.362473 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 57/95] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:16 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:17.412714 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:17.422639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-71983be4-3da6-4727-934e-d05f44f1215c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.272540 May 13 12:55:17.424571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 39/96] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:17 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:17.960578 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-a4bffdef-57a1-4686-a2c3-1b5d12ad3c71 req-0a13b41b-5488-4a5b-b569-dfbd6042b265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83873f65-ba42-4536-9af6-4aff1db77bb4", "tag": "312207b7-e73e-4ced-8336-af184bb733a6"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:18.002944 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-a4bffdef-57a1-4686-a2c3-1b5d12ad3c71 req-0a13b41b-5488-4a5b-b569-dfbd6042b265 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:18.003910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-a4bffdef-57a1-4686-a2c3-1b5d12ad3c71 req-0a13b41b-5488-4a5b-b569-dfbd6042b265 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:18.036440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-a4bffdef-57a1-4686-a2c3-1b5d12ad3c71 req-0a13b41b-5488-4a5b-b569-dfbd6042b265 service nova] Creating event network-changed:312207b7-e73e-4ced-8336-af184bb733a6 for instance 83873f65-ba42-4536-9af6-4aff1db77bb4 on hv-cinder-84164 May 13 12:55:18.038610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-a4bffdef-57a1-4686-a2c3-1b5d12ad3c71 req-0a13b41b-5488-4a5b-b569-dfbd6042b265 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081428 May 13 12:55:18.039575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 58/97] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:18.382034 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:18.383286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:18.395592 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:18.396041 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:18.401245 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:18.401785 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:18.407690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-53330253-164a-48eb-a220-97525e1c55a8 req-2f59d8f7-8677-4e9c-865d-f5a56ab64d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2825cd-1b9d-4434-bf94-ebf3f6688015", "name": "network-vif-plugged", "status": "completed", "tag": "2f8c0546-7559-4827-9638-ab93068addc3"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:18.420563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-53330253-164a-48eb-a220-97525e1c55a8 req-2f59d8f7-8677-4e9c-865d-f5a56ab64d2c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:18.423753 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-53330253-164a-48eb-a220-97525e1c55a8 req-2f59d8f7-8677-4e9c-865d-f5a56ab64d2c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:18.446895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-53330253-164a-48eb-a220-97525e1c55a8 req-2f59d8f7-8677-4e9c-865d-f5a56ab64d2c service nova] Creating event network-vif-plugged:2f8c0546-7559-4827-9638-ab93068addc3 for instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 on hv-cinder-84164 May 13 12:55:18.474034 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-53330253-164a-48eb-a220-97525e1c55a8 req-2f59d8f7-8677-4e9c-865d-f5a56ab64d2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052203 May 13 12:55:18.478316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 59/98] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:55:18.484637 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:18.485657 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:18.492017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:18.492719 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:18.493815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:18.494495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:18.697969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:18.699813 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:18.706569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3f2d0086-db33-45ef-a2f5-37ca67cc5fa8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.330677 May 13 12:55:18.717510 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 40/99] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:18 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:18.720902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-96f36710-6877-45e5-901d-de6dc774135d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1367 microversion: 2.1 time: 0.240271 May 13 12:55:18.721483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 60/100] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:18 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:19.723646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:19.724261 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:19.732149 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:19.732612 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:19.733413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:19.733855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:19.737283 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:19.737923 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:19.743625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:19.744074 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:19.744835 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:19.745292 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:19.882689 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:19.891766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2c6225f3-91b1-4360-ab4e-80e81e699a0c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.171885 May 13 12:55:19.892768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 41/101] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:19 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:19.895112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:19.907794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-421a1d70-0f55-4459-bd98-802c95c14c22 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1557 microversion: 2.1 time: 0.174215 May 13 12:55:19.908379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 61/102] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:19 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:19.924819 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b7adca74-9548-4e08-8a62-f3ff16983113 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:19.925409 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b7adca74-9548-4e08-8a62-f3ff16983113 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:19.931767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b7adca74-9548-4e08-8a62-f3ff16983113 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:19.932311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b7adca74-9548-4e08-8a62-f3ff16983113 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:19.933463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b7adca74-9548-4e08-8a62-f3ff16983113 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:19.933984 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b7adca74-9548-4e08-8a62-f3ff16983113 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:20.016110 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b7adca74-9548-4e08-8a62-f3ff16983113 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095154 May 13 12:55:20.016807 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 42/103] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:55:19 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:20.909119 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:20.909807 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:20.916292 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:20.916722 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:20.918098 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:20.918713 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:21.171817 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:21.184290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-520d2882-f6bb-469c-887b-2fb7e3e6b81b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.278951 May 13 12:55:21.185909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 62/104] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:20 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:22.027721 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-fac1c8f8-4070-4af4-b070-9f2d44bca2bf req-5ff0627a-5013-4517-b473-e980bd793323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34789621-2e0a-4fef-8268-7703885edac6", "tag": "99a73876-f6c7-452e-b541-5ee509349a0a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:22.041441 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-fac1c8f8-4070-4af4-b070-9f2d44bca2bf req-5ff0627a-5013-4517-b473-e980bd793323 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:22.042786 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-fac1c8f8-4070-4af4-b070-9f2d44bca2bf req-5ff0627a-5013-4517-b473-e980bd793323 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:22.056629 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-fac1c8f8-4070-4af4-b070-9f2d44bca2bf req-5ff0627a-5013-4517-b473-e980bd793323 service nova] Creating event network-changed:99a73876-f6c7-452e-b541-5ee509349a0a for instance 34789621-2e0a-4fef-8268-7703885edac6 on hv-cinder-84164 May 13 12:55:22.064139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-fac1c8f8-4070-4af4-b070-9f2d44bca2bf req-5ff0627a-5013-4517-b473-e980bd793323 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042443 May 13 12:55:22.065302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 43/105] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:22.088666 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:22.089678 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:22.097190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:22.097190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:22.097788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:22.098230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:22.127377 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:55:22.203767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:22.204481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:22.214022 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:22.215302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:22.216536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:22.217267 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:22.272717 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fe390e82-b1da-44ce-aaae-9855517334f5 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 204 len: 0 microversion: 2.1 time: 0.187428 May 13 12:55:22.273930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 63/106] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:55:22 2022] DELETE /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 12:55:22.294679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:22.295380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:22.306222 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:22.307129 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:22.312698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:22.313385 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:22.449807 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:22.458312 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-44becd36-9e17-4d0c-b575-eba0476211ff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1321 microversion: 2.1 time: 0.260302 May 13 12:55:22.460939 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 44/107] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:22 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:22.517146 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:22.532910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-adf07d1b-245b-4e88-b614-3e62f133adea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1553 microversion: 2.1 time: 0.242793 May 13 12:55:22.545743 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 64/108] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:22 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:23.476036 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:23.480583 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:23.502983 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:23.503664 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:23.504638 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:23.505246 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:23.555633 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:23.556245 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:23.565972 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:23.566418 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:23.569804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:23.570299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:23.793405 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:23.803062 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a76272de-1751-4166-84bb-1a22061580d4 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1553 microversion: 2.1 time: 0.251128 May 13 12:55:23.804593 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 65/109] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:23 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:23.818329 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:23.827145 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cf9a4c99-decd-44b3-9b09-b632683ddba7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1515 microversion: 2.1 time: 0.355127 May 13 12:55:23.828274 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 45/110] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:23 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:23.845968 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:23.847200 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:23.853617 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:23.854589 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:23.856413 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:23.857172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:23.885298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lazy-loading 'flavor' on Instance uuid 9f2825cd-1b9d-4434-bf94-ebf3f6688015 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:55:24.077490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1e39557e-301e-47db-848e-cbab51400fcf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015/action" status: 200 len: 32 microversion: 2.1 time: 0.236658 May 13 12:55:24.080733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 66/111] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:55:23 2022] POST /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 12:55:24.091826 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:24.092513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:24.099680 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:24.100366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:24.101207 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:24.101847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:24.265442 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:24.273767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f34097e8-16c0-4547-b56e-f65745417c56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.188091 May 13 12:55:24.275319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 46/112] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:24 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:24.823330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:24.825738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:24.836305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:24.836923 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:24.837895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:24.838609 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:25.011327 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:25.029390 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a12f00ee-59d1-4b8b-8085-0213163bb1dd tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1553 microversion: 2.1 time: 0.209370 May 13 12:55:25.029479 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 67/113] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:24 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:25.296677 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:25.297373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:25.304406 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:25.304941 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:25.306343 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:25.306343 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:25.443158 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:25.451191 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-418b4e21-a4c0-4de1-a4a2-7f2b2b8f1c68 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.159391 May 13 12:55:25.451830 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 47/114] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:25 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:26.045609 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:26.046856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:26.053596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:26.054238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:26.055356 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:26.055945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:26.189589 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:26.197701 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-780bc562-2488-4900-a605-3d99a210a3ef tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1553 microversion: 2.1 time: 0.156388 May 13 12:55:26.198386 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 68/115] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:26 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:26.468118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:26.468765 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:26.475059 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:26.475591 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:26.476432 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:26.476989 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:26.631386 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:26.640509 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dd5b5d26-cbcb-4935-a4b7-8dca86a5a0fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.176669 May 13 12:55:26.641399 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 48/116] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:26 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:27.215648 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:27.216201 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:27.222036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:27.222486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:27.223261 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:27.223691 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:27.349878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:27.357634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5e8d8f09-d376-44dc-afe4-2100206fffcb tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1553 microversion: 2.1 time: 0.146316 May 13 12:55:27.358201 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 69/117] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:27 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:27.657830 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:27.658596 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:27.664903 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:27.665427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:27.666152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:27.666588 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:27.793744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:27.801031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fe385692-9e3a-4e3f-a2ee-a55faf5467da tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.146988 May 13 12:55:27.801538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 49/118] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:27 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:28.374776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:28.375608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:28.381953 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:28.382423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:28.383196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:28.383627 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:28.614990 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:28.624601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-90391833-cfc7-429e-9fc8-3ec23cd1132b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1553 microversion: 2.1 time: 0.254060 May 13 12:55:28.625432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 70/119] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:28 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:28.818629 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:28.819283 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:28.826620 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:28.827078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:28.827913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:28.828393 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:29.224857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:29.234268 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-177451eb-2895-46e6-8fd4-b67fa2862b37 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.419503 May 13 12:55:29.235336 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 50/120] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:28 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:29.459450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-6347a658-a616-4a1a-b68f-19c89272d561 req-5c259b43-88dd-48cd-806b-119f1305bd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10c17e5-f9fb-4451-bb6a-7b1184b89c69", "name": "network-vif-deleted", "tag": "10edcfdf-27bf-47e2-bc00-13c44bd9924a"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:29.467920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-6347a658-a616-4a1a-b68f-19c89272d561 req-5c259b43-88dd-48cd-806b-119f1305bd93 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:29.468369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-6347a658-a616-4a1a-b68f-19c89272d561 req-5c259b43-88dd-48cd-806b-119f1305bd93 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:29.480098 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-6347a658-a616-4a1a-b68f-19c89272d561 req-5c259b43-88dd-48cd-806b-119f1305bd93 service nova] Creating event network-vif-deleted:10edcfdf-27bf-47e2-bc00-13c44bd9924a for instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 on hv-cinder-84164 May 13 12:55:29.485727 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-6347a658-a616-4a1a-b68f-19c89272d561 req-5c259b43-88dd-48cd-806b-119f1305bd93 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029754 May 13 12:55:29.486253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 71/121] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:29.641526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:29.642145 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:29.648108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:29.648560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:29.649361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:29.649800 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:29.711624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:29.720140 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-61ddbce3-6989-43b8-a433-6129fa486291 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1511 microversion: 2.1 time: 0.082336 May 13 12:55:29.720720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 51/122] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:29 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1511 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:30.256332 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:30.257218 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:30.264259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:30.264716 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:30.265513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:30.265952 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:30.396770 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:30.405371 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2b97ef0f-4937-40ec-9399-521ac177f42e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.153471 May 13 12:55:30.405992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 72/123] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:30 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:30.736967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:30.737595 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:30.744103 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:30.744558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:30.745379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:30.745820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:30.809742 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:30.818153 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0ccf5eb9-5817-41a2-9694-70f6e645c6ea tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1511 microversion: 2.1 time: 0.085456 May 13 12:55:30.818739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 52/124] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:30 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:31.422931 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:31.423539 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:31.429843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:31.430287 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:31.431050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:31.431514 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:31.778451 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:31.787113 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0223df61-9b37-415f-8fd9-b4919f5e4b21 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.368595 May 13 12:55:31.787696 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 73/125] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:31 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:31.835411 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:31.836026 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:31.843219 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:31.843672 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:31.844434 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:31.844869 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:31.907753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:31.915519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9940a85d-a4eb-45e9-962c-379abad44a72 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1511 microversion: 2.1 time: 0.083910 May 13 12:55:31.916090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 53/126] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:31 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:32.803538 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:32.804150 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:32.810087 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:32.810537 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:32.811863 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:32.812295 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:32.932032 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:32.932734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:32.940465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:32.941169 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:32.942065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:32.942608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:32.958783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:32.968575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-84f2c304-0b8b-4490-90c3-3a4bd726b3e7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.168714 May 13 12:55:32.969879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 74/127] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:32 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:33.015147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:33.023193 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fc938712-86db-4135-a10a-96bdab7e37ba tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1346 microversion: 2.1 time: 0.095464 May 13 12:55:33.024741 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 54/128] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:32 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:33.985425 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:33.986041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:33.991950 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:33.992407 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:33.993210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:33.993647 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:34.040113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:34.040834 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:34.047687 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:34.048378 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:34.049259 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:34.049772 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:34.116913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:34.124887 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-800bb162-d693-430e-8ac2-ff9970a65153 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1346 microversion: 2.1 time: 0.089190 May 13 12:55:34.125492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 55/129] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:34 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:34.125859 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:34.133319 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e80f9277-98ec-4815-972b-36bb0f71f4bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.151927 May 13 12:55:34.133882 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 75/130] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:33 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:35.141598 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:35.142330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:35.148842 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:35.149317 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:35.150083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:35.150521 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:35.150881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:35.151884 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:35.158588 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:35.159136 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:35.159976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:35.160480 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:35.211026 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:35.219352 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-475dfe41-e656-458b-b8bc-f39f3742810e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1346 microversion: 2.1 time: 0.081516 May 13 12:55:35.219915 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 56/131] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:35 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:35.286216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:35.293445 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f8f4b943-78f2-4fd4-a1d3-e272d62bdd7f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.146674 May 13 12:55:35.294008 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 76/132] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:35 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:36.236929 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:36.237475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:36.244008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:36.244457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:36.245247 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:36.245683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:36.311714 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:36.312615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:36.318281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbe87047c574127861cf1e4944c0fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612784cc2dcc45b1b71ec19fc213f48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:36.321482 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:36.321939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:36.322753 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:36.323194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:36.328332 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0b7fa852-a81f-4a22-9005-e9f9daa9938e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 200 len: 1346 microversion: 2.1 time: 0.095862 May 13 12:55:36.329068 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 57/133] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:36 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:36.460194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:36.468620 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-093f1791-4722-4f7a-81cb-711065ecaf32 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.161467 May 13 12:55:36.469231 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 77/134] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:36 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:37.346353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:37.347009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:37.353423 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:37.353886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:37.354664 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:37.355107 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:37.369443 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] HTTP exception thrown: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Request method failure captured: May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 HTTP/1.1 May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflT_ulSAT55z3s8XqQ4anBGmbRwNFhjwEz23Z4fRR1kpV01kD8Ml1L3reN1dJiN91qX7_HUwbcpufg2NA2rCXaIO6OU-sAYNIbARu_6IAjCWw5HTW8eSkOCfDxLX695Jz8cMnjvxEGx9_KDQ3_FwmTPCY0MLVbHsjv4Y8gb52uAGpnY May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:55:37.375276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_612784cc2dcc45b1b71ec19fc213f48f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 5cbe87047c574127861cf1e4944c0fff May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.376519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'b10c17e5-f9fb-4451-bb6a-7b1184b89c69'} May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:55:37.377225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.378479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:37.379426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Returning 404 to user: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:55:37.379426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3ab7eeeb-d55e-4e4f-b5a8-1aa31eb2763b tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 404 len: 111 microversion: 2.1 time: 0.035104 May 13 12:55:37.379426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 58/135] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:37 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:55:37.481754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:37.483554 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:37.486290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:37.487182 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:37.492438 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:37.493328 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:37.493647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:37.494106 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:37.494889 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:37.495379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:37.495527 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:37.496032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:37.516927 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] HTTP exception thrown: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Request method failure captured: May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69/os-volume_attachments HTTP/1.1 May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflT_ulSAT55z3s8XqQ4anBGmbRwNFhjwEz23Z4fRR1kpV01kD8Ml1L3reN1dJiN91qX7_HUwbcpufg2NA2rCXaIO6OU-sAYNIbARu_6IAjCWw5HTW8eSkOCfDxLX695Jz8cMnjvxEGx9_KDQ3_FwmTPCY0MLVbHsjv4Y8gb52uAGpnY May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 12:55:37.523290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_612784cc2dcc45b1b71ec19fc213f48f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 5cbe87047c574127861cf1e4944c0fff May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.524465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'server_id': 'b10c17e5-f9fb-4451-bb6a-7b1184b89c69'} May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:55:37.525162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:37.526235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:55:37.527562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Returning 404 to user: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:55:37.527562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4fa1835b-dc32-45e5-8322-5528afce062f tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048181 May 13 12:55:37.527562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 78/136] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:55:37 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:55:37.648696 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:37.657592 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d0e3b66b-45d3-413a-8966-680c50942761 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.175768 May 13 12:55:37.658152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 59/137] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:37 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:38.674326 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:38.675093 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:38.682766 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:38.683053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:38.683958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:38.684464 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:38.732038 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:38.732615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:38.739033 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:38.739481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:38.740484 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:38.740925 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:38.754529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] HTTP exception thrown: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Request method failure captured: May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 HTTP/1.1 May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflT_ulSAT55z3s8XqQ4anBGmbRwNFhjwEz23Z4fRR1kpV01kD8Ml1L3reN1dJiN91qX7_HUwbcpufg2NA2rCXaIO6OU-sAYNIbARu_6IAjCWw5HTW8eSkOCfDxLX695Jz8cMnjvxEGx9_KDQ3_FwmTPCY0MLVbHsjv4Y8gb52uAGpnY May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:55:38.756073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_612784cc2dcc45b1b71ec19fc213f48f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 5cbe87047c574127861cf1e4944c0fff May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.757230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'b10c17e5-f9fb-4451-bb6a-7b1184b89c69'} May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:55:38.757857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.758907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.759986 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Returning 404 to user: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:55:38.759986 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cf0dc453-08bc-438f-9097-45ad4add9d5e tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 404 len: 111 microversion: 2.1 time: 0.029258 May 13 12:55:38.759986 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 60/138] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:55:38 2022] DELETE /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 12:55:38.766172 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:38.766804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] [instance: b10c17e5-f9fb-4451-bb6a-7b1184b89c69] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:38.772605 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:38.773084 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:38.773858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:38.774297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:38.789034 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] HTTP exception thrown: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Request method failure captured: May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 HTTP/1.1 May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflT_ulSAT55z3s8XqQ4anBGmbRwNFhjwEz23Z4fRR1kpV01kD8Ml1L3reN1dJiN91qX7_HUwbcpufg2NA2rCXaIO6OU-sAYNIbARu_6IAjCWw5HTW8eSkOCfDxLX695Jz8cMnjvxEGx9_KDQ3_FwmTPCY0MLVbHsjv4Y8gb52uAGpnY May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:55:38.790576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_612784cc2dcc45b1b71ec19fc213f48f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/612784cc2dcc45b1b71ec19fc213f48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 612784cc2dcc45b1b71ec19fc213f48f May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1651286599 May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 5cbe87047c574127861cf1e4944c0fff May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-DeleteServersTestJSON-1651286599-project May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.791748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'b10c17e5-f9fb-4451-bb6a-7b1184b89c69'} May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:55:38.792419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. May 13 12:55:38.794265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:55:38.796388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] Returning 404 to user: Instance b10c17e5-f9fb-4451-bb6a-7b1184b89c69 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:55:38.796388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3427006c-4a92-4561-a8ad-b12bbf8d51e7 tempest-DeleteServersTestJSON-1651286599 tempest-DeleteServersTestJSON-1651286599-project] 10.222.0.49 "GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69" status: 404 len: 111 microversion: 2.1 time: 0.029923 May 13 12:55:38.796388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 61/139] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:38 2022] GET /compute/v2.1/servers/b10c17e5-f9fb-4451-bb6a-7b1184b89c69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 12:55:38.829194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:38.837314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-61233a0c-76f4-4551-9adc-1396d8aab89f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.166919 May 13 12:55:38.838005 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 79/140] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:38 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:39.854490 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:39.855677 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:39.866428 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:39.867057 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:39.867919 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:39.868595 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:40.088850 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:40.098651 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4d31cc6c-e3bb-433d-b6e4-b289e05ea03e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.247737 May 13 12:55:40.108431 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 62/141] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:39 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:41.122382 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:41.123014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:41.134006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:41.134997 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:41.136095 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:41.136704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:41.325817 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:41.335771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ef7a7c00-5e1c-4b47-826d-f4023392040c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.218285 May 13 12:55:41.337292 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 80/142] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:41 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:42.357012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:42.358577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:42.370731 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:42.371269 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:42.372371 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:42.373013 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:42.581592 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:42.590429 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f3a5160d-35ec-4285-b17a-c09107d1b4b9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.239035 May 13 12:55:42.591110 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 63/143] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:42 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:43.607915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:43.608536 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:43.614840 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:43.615511 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:43.616465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:43.617097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:43.952183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:43.960661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c0e01014-3cc4-4685-8ee7-6e94fc8473ab tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.356552 May 13 12:55:43.961899 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 81/144] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:43 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:44.981904 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:44.983818 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:45.000300 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:45.002194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:45.003375 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:45.004283 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:45.185681 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:45.199655 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f5dfc886-9ee0-46b7-ba0f-6ca3df383cee tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.223637 May 13 12:55:45.200278 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 64/145] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:44 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:45.684070 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-15499fa1-de4d-4888-ae8e-dd25b7ebeb62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'create', calling method: .version_select at 0x7f0604151d30>, body: {"keypair": {"name": "tempest-keypair-954792090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeImQ2Zn/ptGxQbmbQkwQEtbkcMvSFewwTEuiXeDZsYgcWShyvEK8N4enJhl5eC60YR/riEriO2u6OMEYTOl8Bv3n1kGJC1P5U5bP7zFwk1og32+m6IjomAk8lY5Qcf1w=="}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:45.707054 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-15499fa1-de4d-4888-ae8e-dd25b7ebeb62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for project a8e091db3cd14ecb9c40257451cd434d. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:55:45.710869 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-15499fa1-de4d-4888-ae8e-dd25b7ebeb62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for user 88bc7138e3d5438b9a96744e22add357 and project a8e091db3cd14ecb9c40257451cd434d. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:55:45.746380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-15499fa1-de4d-4888-ae8e-dd25b7ebeb62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178586 May 13 12:55:45.747202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 82/146] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 12:55:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:55:46.218624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:46.219253 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:46.225535 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:46.225989 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:46.226766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:46.227203 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:46.440260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:46.451080 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-70949a21-e3a9-460e-8ca6-9ea6d76bb98a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.236835 May 13 12:55:46.451960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 65/147] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:46 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:47.194863 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1747410167", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e48d261-a2df-43c6-bd2a-fa0153331d4d"}], "security_groups": [{"name": "tempest-securitygroup--1516145916"}], "key_name": "tempest-keypair-954792090", "user_data": "}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:47.471052 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:47.471679 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:47.478437 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:47.478898 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:47.479737 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:47.480116 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:47.641658 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:47.650291 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c0a39c27-1592-43a6-8984-370a86216f9d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.185905 May 13 12:55:47.651217 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 66/148] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:47 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:48.673663 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:48.674305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:48.681398 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:48.682090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:48.683024 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:48.683619 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:48.754849 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] validate_networks() for [('2e48d261-a2df-43c6-bd2a-fa0153331d4d', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:55:48.864479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:48.872190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fc0dc519-ac30-4e84-8f45-cdd0bf894719 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.208492 May 13 12:55:48.875967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 67/149] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:48 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:49.179846 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:55:49.180301 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:55:49.180806 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:55:49.181258 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:55:49.181679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:55:49.190582 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:49.191246 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:49.192040 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:49.192646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:49.210869 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for project a8e091db3cd14ecb9c40257451cd434d. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:55:49.215028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for user 88bc7138e3d5438b9a96744e22add357 and project a8e091db3cd14ecb9c40257451cd434d. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:55:49.227849 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:55:49.230250 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:55:49.287024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-36f29e61-4e31-46a4-817b-c7d01f4822eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.096552 May 13 12:55:49.288083 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 83/150] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:55:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 12:55:49.298167 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e07bbf38-914c-443a-89b8-9b53aebc6408 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:49.299023 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e07bbf38-914c-443a-89b8-9b53aebc6408 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:49.363203 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e07bbf38-914c-443a-89b8-9b53aebc6408 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:49.372462 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e07bbf38-914c-443a-89b8-9b53aebc6408 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1237 microversion: 2.1 time: 0.078169 May 13 12:55:49.382835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 68/151] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:49 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:49.891514 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:49.892137 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:49.898379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:49.898835 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:49.899624 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:49.900064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:50.056754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:50.065116 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a994280d-d4c4-4fdc-833b-8cff854a051c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.178290 May 13 12:55:50.065874 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 84/152] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:49 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:50.391081 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:50.392215 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:50.399616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:50.400074 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:50.400860 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:50.401463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:50.480656 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:50.497313 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1c9ae5af-4826-4bd2-829d-65a14847f55e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1289 microversion: 2.1 time: 0.101968 May 13 12:55:50.498543 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 69/153] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:50 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:51.083459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:51.084133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:51.090676 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:51.091133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:51.092074 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:51.092645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:51.335937 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:51.346213 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3a6c8cb2-22a8-419c-bc7f-c53d6d47d4b4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.266726 May 13 12:55:51.347058 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 85/154] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:51 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:51.515890 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:51.516829 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:51.529270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:51.531725 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:51.532689 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:51.533570 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:51.739237 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:51.752886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5e794fb8-e5df-4bac-b499-125033648a77 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.242129 May 13 12:55:51.753716 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 70/155] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:51 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:52.363962 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:52.364558 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:52.375158 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:52.375619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:52.376412 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:52.377006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:52.427692 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-49c8e026-c705-4e89-94fc-95e8251774b1 req-ef9d7107-9602-4b21-99d0-14c598e9961c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a805ac8a-8fbf-4bf1-b369-64eaef204809", "tag": "fec89e37-51dd-4063-9de3-e584ce441fb2"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:55:52.437733 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-49c8e026-c705-4e89-94fc-95e8251774b1 req-ef9d7107-9602-4b21-99d0-14c598e9961c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:52.438385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-49c8e026-c705-4e89-94fc-95e8251774b1 req-ef9d7107-9602-4b21-99d0-14c598e9961c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:52.450943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-49c8e026-c705-4e89-94fc-95e8251774b1 req-ef9d7107-9602-4b21-99d0-14c598e9961c service nova] Creating event network-changed:fec89e37-51dd-4063-9de3-e584ce441fb2 for instance a805ac8a-8fbf-4bf1-b369-64eaef204809 on hv-cinder-84164 May 13 12:55:52.456582 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-49c8e026-c705-4e89-94fc-95e8251774b1 req-ef9d7107-9602-4b21-99d0-14c598e9961c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036617 May 13 12:55:52.457238 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 71/156] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:55:52.565767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:52.574371 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f24302eb-f673-4430-ad3c-ab94f570a919 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.214530 May 13 12:55:52.575320 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 86/157] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:52 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:52.772384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:52.773350 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:52.780493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:52.780958 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:52.781996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:52.782503 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:52.935030 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:52.943081 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3652b802-1d19-4a4f-a782-d28a4c4afc28 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.175634 May 13 12:55:52.943928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 72/158] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:52 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:53.593467 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:53.593467 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:53.597960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:53.598414 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:53.599192 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:53.599673 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:53.727208 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:53.735350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f2ed8a9f-ae48-4bea-b14a-57809c9959a7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.147480 May 13 12:55:53.736080 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 87/159] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:53 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:53.960658 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:53.961812 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:53.972413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:53.973226 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:53.974071 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:53.974521 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:54.101395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:54.109272 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ce8aaec0-a87a-428a-881c-8368154a7e8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.152404 May 13 12:55:54.109842 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 73/160] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:53 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:54.754550 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:54.755758 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:54.769032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:54.769786 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:54.770748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:54.771381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:55.007052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:55.026381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c1600d49-d877-4172-a825-d75d60b4f7bb tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.275383 May 13 12:55:55.027241 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 88/161] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:54 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:55.126928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:55.127774 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:55.134488 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:55.134937 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:55.135716 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:55.136150 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:55.275777 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:55.284569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a9e17a5c-d8b5-4c65-8dc7-7772305e4bfb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.162414 May 13 12:55:55.296006 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 74/162] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:55 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:56.043608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:56.044289 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:56.050680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:56.051126 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:56.052002 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:56.052381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:56.189587 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:56.196920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6b172910-5d61-4621-b212-3229b290d760 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.157164 May 13 12:55:56.197524 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 89/163] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:56 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:56.303647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:56.304180 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:56.310444 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:56.310893 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:56.311729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:56.312347 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:56.448935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:56.457447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dbc9ccf2-da2f-42fe-8e24-62eb51c59b46 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.157650 May 13 12:55:56.458068 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 75/164] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:56 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:57.215073 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:57.215683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:57.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:57.222190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:57.222947 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:57.223375 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:57.356772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:57.364549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-68d3589f-ce5a-4285-afae-cbbd73e62aa5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.153397 May 13 12:55:57.365138 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 90/165] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:57 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:57.474197 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:57.474815 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:57.481069 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:57.481524 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:57.482288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:57.482728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:57.611952 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:57.619114 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9ae9f75c-baca-4e0f-94ed-efa282102351 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.148866 May 13 12:55:57.619679 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 76/166] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:57 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:58.381992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:58.382607 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:58.388459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:58.388912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:58.389968 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:58.390422 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:58.520187 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:58.527778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-dcce796a-677b-47ae-b417-cdc37f4116c0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.149616 May 13 12:55:58.528350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 91/167] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:58 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:58.635546 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:58.636161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:58.642982 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:58.643435 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:58.644202 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:58.644644 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:58.798349 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:58.805597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f6adbf1f-7b83-4b25-8ee2-ab289040fbe4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.173873 May 13 12:55:58.806171 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 77/168] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:58 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:55:59.545129 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:59.545741 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:59.553991 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:59.554439 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:59.555228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:59.555699 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:59.689010 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:59.696453 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-00e0f87b-1d81-4685-b9bf-6e677a67bdc6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.155217 May 13 12:55:59.697046 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 92/169] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:59 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:55:59.822779 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:55:59.823402 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:55:59.830477 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:59.830934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:59.831710 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:55:59.832153 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:55:59.962566 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:55:59.975223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f1b0cb9b-ac11-4e61-aa63-2829e45f4431 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.155969 May 13 12:55:59.984270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 78/170] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:55:59 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:00.713362 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:00.713978 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:00.720647 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:00.721137 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:00.721901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:00.722331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:00.854854 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:00.863611 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b61be6f8-1c52-4c70-bdc5-72d47e6f68cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.153975 May 13 12:56:00.864202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 93/171] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:00 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:00.991762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:00.992374 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:00.998702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:00.999258 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:01.000055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:01.000487 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:01.128380 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:01.135792 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-503210f6-fd3a-401d-91db-81d5970170f8 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.148030 May 13 12:56:01.136367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 79/172] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:00 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:01.881617 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:01.882234 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:01.888185 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:01.888645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:01.889508 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:01.889951 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:02.020786 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:02.028382 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-941f2a89-0741-4d0f-a540-7b1b0ebe66f6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.150823 May 13 12:56:02.028954 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 94/173] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:01 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:02.153522 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:02.154148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:02.160948 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:02.161434 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:02.162194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:02.162629 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:02.287247 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:02.294419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fa4bcdec-2582-4de7-9dce-35ea091a0545 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.144973 May 13 12:56:02.294985 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 80/174] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:02 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:03.046192 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:03.046829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:03.052881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:03.053358 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:03.054118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:03.054605 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:03.186432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:03.195068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-836ab971-2532-4094-90c4-11febdccdc29 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.152886 May 13 12:56:03.195646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 95/175] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:03 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:03.311590 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:03.312202 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:03.319366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:03.319824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:03.320604 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:03.321063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:03.453653 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:03.461282 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3988df03-831a-4f91-a87a-154918f2fd2e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.153448 May 13 12:56:03.461863 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 81/176] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:03 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:03.486252 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-14f39fc1-1cf7-4601-bbba-75723b3aa667 req-669c7467-4b4e-4ddd-a4fe-8141114f2d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a805ac8a-8fbf-4bf1-b369-64eaef204809", "name": "network-vif-plugged", "status": "completed", "tag": "fec89e37-51dd-4063-9de3-e584ce441fb2"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:03.496881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-14f39fc1-1cf7-4601-bbba-75723b3aa667 req-669c7467-4b4e-4ddd-a4fe-8141114f2d95 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:03.497377 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-14f39fc1-1cf7-4601-bbba-75723b3aa667 req-669c7467-4b4e-4ddd-a4fe-8141114f2d95 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:03.509183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-14f39fc1-1cf7-4601-bbba-75723b3aa667 req-669c7467-4b4e-4ddd-a4fe-8141114f2d95 service nova] Creating event network-vif-plugged:fec89e37-51dd-4063-9de3-e584ce441fb2 for instance a805ac8a-8fbf-4bf1-b369-64eaef204809 on hv-cinder-84164 May 13 12:56:03.514188 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-14f39fc1-1cf7-4601-bbba-75723b3aa667 req-669c7467-4b4e-4ddd-a4fe-8141114f2d95 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032487 May 13 12:56:03.514802 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 96/177] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:04.211426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:04.212089 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:04.217991 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:04.218440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:04.219364 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:04.219821 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:04.345865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:04.353102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-24f2efb8-b1e5-4f68-9fd9-98ee89aec24c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.145514 May 13 12:56:04.353670 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 82/178] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:04 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:04.478334 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:04.479037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:04.485673 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:04.486123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:04.486885 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:04.487317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:04.618017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:04.625233 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-bab0b390-05a2-42ea-a40f-c80c704f4b89 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1363 microversion: 2.1 time: 0.150957 May 13 12:56:04.625805 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 97/179] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:04 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:05.371207 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:05.371833 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:05.380161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:05.380616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:05.381423 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:05.381947 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:05.520734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:05.528353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-24171f56-0bdd-4390-8dee-8a440c1bf57c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.161686 May 13 12:56:05.528922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 83/180] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:05 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:05.641272 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:05.642122 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:05.648256 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:05.648715 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:05.649531 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:05.649971 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:05.921653 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:05.930634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4d5bb01e-7a54-4a87-ba39-d9b3e67e9b64 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1550 microversion: 2.1 time: 0.293201 May 13 12:56:05.931205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 98/181] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:05 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1550 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:05.946804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b9138d57-928e-4d7a-bc57-53de3892014b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:05.947301 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b9138d57-928e-4d7a-bc57-53de3892014b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:05.953153 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9138d57-928e-4d7a-bc57-53de3892014b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:05.953607 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9138d57-928e-4d7a-bc57-53de3892014b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:05.954404 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9138d57-928e-4d7a-bc57-53de3892014b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:05.954844 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9138d57-928e-4d7a-bc57-53de3892014b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:06.035953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b9138d57-928e-4d7a-bc57-53de3892014b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092837 May 13 12:56:06.036550 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 84/182] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:56:05 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:06.545809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:06.546680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:06.552838 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:06.553769 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:06.554734 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:06.555250 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:06.701299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:06.713871 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5814ec5a-a160-48df-bba1-c87025f7556d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.172013 May 13 12:56:06.723702 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 99/183] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:06 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:07.314382 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-08fc592b-9abb-437c-891d-949d9a44610f req-8a2e1f7c-2317-400f-b4c8-37377d2bfa25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a805ac8a-8fbf-4bf1-b369-64eaef204809", "tag": "fec89e37-51dd-4063-9de3-e584ce441fb2"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:07.322698 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-08fc592b-9abb-437c-891d-949d9a44610f req-8a2e1f7c-2317-400f-b4c8-37377d2bfa25 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:07.323412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-08fc592b-9abb-437c-891d-949d9a44610f req-8a2e1f7c-2317-400f-b4c8-37377d2bfa25 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:07.334721 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-08fc592b-9abb-437c-891d-949d9a44610f req-8a2e1f7c-2317-400f-b4c8-37377d2bfa25 service nova] Creating event network-changed:fec89e37-51dd-4063-9de3-e584ce441fb2 for instance a805ac8a-8fbf-4bf1-b369-64eaef204809 on hv-cinder-84164 May 13 12:56:07.340465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-08fc592b-9abb-437c-891d-949d9a44610f req-8a2e1f7c-2317-400f-b4c8-37377d2bfa25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029924 May 13 12:56:07.341354 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 85/184] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:07.731659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:07.732886 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:07.739629 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:07.740088 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:07.740876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:07.741344 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:07.895253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:07.903503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-51f3d930-b427-4889-8211-5a7470cf6f9b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.176031 May 13 12:56:07.904074 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 100/185] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:07 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:08.921938 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:08.922639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:08.928730 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:08.929228 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:08.930000 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:08.930440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:09.062063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:09.070539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ebb24d7f-d5db-49bf-9fdc-d2c9fb44570e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.153323 May 13 12:56:09.071106 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 86/186] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:08 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:10.087104 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:10.087717 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:10.093667 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:10.094121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:10.095531 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:10.095976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:10.256525 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:10.264735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ef34a46e-fa23-4b87-8238-c65330840c23 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.181439 May 13 12:56:10.265334 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 101/187] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:10 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:11.282574 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:11.283319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:11.289961 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:11.290410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:11.291170 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:11.291605 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:11.419075 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:11.428829 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f8e8e318-f5f6-47c2-8a36-75345849ba70 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.150544 May 13 12:56:11.429640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 87/188] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:11 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:12.454000 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:12.455192 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:12.462067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:12.462526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:12.463307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:12.463771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:12.596023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:12.603515 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8c74d7dc-6fc6-4311-94b2-eef57bb04349 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.153457 May 13 12:56:12.604088 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 102/189] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:12 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:13.621223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:13.621790 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:13.629200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:13.629654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:13.630431 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:13.631095 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:13.780767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:13.792136 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8b28788d-38e6-4af4-8249-198dae4b4679 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1521 microversion: 2.1 time: 0.175519 May 13 12:56:13.793210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 88/190] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:13 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:14.810529 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:14.811058 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:14.817494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:14.817948 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:14.818713 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:14.819152 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:14.946990 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:14.954424 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a53ddd04-fbc4-4630-8d15-3b5e0496461c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1501 microversion: 2.1 time: 0.147817 May 13 12:56:14.954991 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 103/191] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:14 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:14.970906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:14.971528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:14.978097 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:14.978555 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:14.979330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:14.979772 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:15.113470 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:15.120767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-967e663d-002e-4b79-bdbb-6bc423d6990f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1515 microversion: 2.1 time: 0.153700 May 13 12:56:15.121371 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 89/192] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:14 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:18.792649 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:18.793632 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:18.799452 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:18.799898 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:18.800658 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:18.801194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:18.824721 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lazy-loading 'flavor' on Instance uuid b9ff36f5-3afb-4239-b817-663ac72e599f {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:56:18.894129 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2f2ba47f-fbf9-4e0f-bcc4-311e8d755ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f/action" status: 200 len: 32 microversion: 2.1 time: 0.105365 May 13 12:56:18.894802 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 104/193] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:56:18 2022] POST /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f/action => generated 32 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 12:56:18.905331 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:18.905949 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:18.913836 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:18.914520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:18.915607 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:18.916266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:19.053166 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:19.060487 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f0357b2a-dd4a-4ae8-83a8-2e143c1b19bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.159382 May 13 12:56:19.061083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 90/194] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:18 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:20.078235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:20.078940 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:20.085269 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:20.085724 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:20.086541 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:20.086980 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:20.222310 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:20.230610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a4ee85f4-09a9-48a1-a2be-7631a316e5b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.156518 May 13 12:56:20.231188 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 105/195] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:20 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:21.248508 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:21.249257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:21.256841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:21.257412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:21.258255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:21.258697 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:21.546103 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:21.554559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-706d95ac-e6bf-485f-a022-53e7dec7386f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.309946 May 13 12:56:21.555152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 91/196] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:21 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:22.572420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:22.572940 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:22.579100 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:22.579550 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:22.580314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:22.580752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:22.709318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:22.716710 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3fce4fd5-5e0c-4fa9-a5ca-debf31f9b618 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.148167 May 13 12:56:22.717463 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 106/197] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:22 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:23.733451 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:23.734062 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:23.740582 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:23.741117 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:23.741919 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:23.742349 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:23.873733 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:23.881674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f8483f48-85b3-4ff5-8670-68ab0d0f1f56 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.151966 May 13 12:56:23.882257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 92/198] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:23 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:24.898730 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:24.899373 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:24.905903 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:24.906357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:24.907264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:24.907804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:25.060899 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:25.069283 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e5f149fc-22bd-4fc5-aa46-8644cdd9540b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.174466 May 13 12:56:25.069881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 107/199] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:24 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:26.086207 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:26.086870 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:26.094237 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:26.094720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:26.095690 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:26.096450 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:26.228088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:26.235480 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-39e0425e-6b9d-428d-9271-e282ffe01dfd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.153567 May 13 12:56:26.236337 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 93/200] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:26 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:26.346554 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-228dc322-351e-4a43-980a-34d8dff8311f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:26.347101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-228dc322-351e-4a43-980a-34d8dff8311f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:26.353678 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-228dc322-351e-4a43-980a-34d8dff8311f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:26.354464 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-228dc322-351e-4a43-980a-34d8dff8311f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:26.355261 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-228dc322-351e-4a43-980a-34d8dff8311f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:26.355700 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-228dc322-351e-4a43-980a-34d8dff8311f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:26.381812 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-228dc322-351e-4a43-980a-34d8dff8311f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/ips" status: 200 len: 151 microversion: 2.20 time: 0.039010 May 13 12:56:26.382387 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 108/201] 10.222.0.49 () {60 vars in 1288 bytes} [Fri May 13 12:56:26 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:56:27.253611 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:27.254239 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:27.260696 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:27.261194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:27.261979 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:27.262425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:27.412364 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:27.419967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-34c215a9-1af4-420f-b445-197dc4bbac89 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.170151 May 13 12:56:27.420540 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 94/202] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:27 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:28.437275 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:28.437918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:28.443850 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:28.444294 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:28.445091 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:28.445530 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:28.576820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:28.585063 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-97db1d22-2e69-48ad-81e6-5704c3582173 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.151529 May 13 12:56:28.585635 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 109/203] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:28 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:28.907542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:28.908158 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:28.914530 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:28.915053 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:28.915893 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:28.916411 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:28.943943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lazy-loading 'flavor' on Instance uuid 83873f65-ba42-4536-9af6-4aff1db77bb4 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:56:29.250861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dca2c508-2d74-4c95-afaa-27338223a53e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/action" status: 202 len: 0 microversion: 2.20 time: 0.347005 May 13 12:56:29.251736 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 95/204] 10.222.0.49 () {62 vars in 1318 bytes} [Fri May 13 12:56:28 2022] POST /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 12:56:29.261206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:29.261966 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:29.268810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:29.269441 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:29.270320 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:29.271098 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:29.405320 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:29.413363 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:29.414967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:29.416212 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-de3ed25b-92d1-4fae-b22c-39b7013ba7ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.159160 May 13 12:56:29.416819 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 110/205] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:29 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:29.602005 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:29.602718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:29.608947 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:29.609435 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:29.610214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:29.610680 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:29.794238 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:29.801642 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2dd4bc99-5d3e-4813-bf5c-31a54f9eff33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.204159 May 13 12:56:29.802916 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 96/206] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:29 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:30.084939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-513ad710-ed2a-4313-8f65-53cb89e6d283 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:30.085490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-513ad710-ed2a-4313-8f65-53cb89e6d283 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:30.092295 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-513ad710-ed2a-4313-8f65-53cb89e6d283 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:30.092873 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-513ad710-ed2a-4313-8f65-53cb89e6d283 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:30.093749 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-513ad710-ed2a-4313-8f65-53cb89e6d283 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:30.094217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-513ad710-ed2a-4313-8f65-53cb89e6d283 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:30.128766 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-513ad710-ed2a-4313-8f65-53cb89e6d283 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/ips" status: 200 len: 149 microversion: 2.1 time: 0.047983 May 13 12:56:30.129769 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 111/207] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 12:56:30 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:30.434776 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:30.435394 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:30.442583 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:30.443037 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:30.444061 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:30.444821 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:30.598909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:30.608394 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:30.609923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:30.611093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-50776099-32dd-4cc9-885e-99d7dabbb4fe tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.180449 May 13 12:56:30.611663 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 97/208] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:30 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:30.819115 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:30.819728 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:30.825777 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:30.826228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:30.827035 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:30.827534 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:30.963763 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:30.972847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-16249eb1-452d-4b16-be5b-94cbe188ee06 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.157531 May 13 12:56:30.974625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 112/209] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:30 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:31.629740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:31.630497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:31.638076 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:31.638524 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:31.639376 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:31.639809 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:31.773878 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:31.781947 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:31.783504 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:31.784707 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8c0ea9e2-231d-473d-a87c-45f25d856ab0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.159343 May 13 12:56:31.785330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 98/210] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:31 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:31.990087 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:31.991078 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:31.997795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:31.998317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:31.999186 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:31.999691 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:32.136939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:32.144404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0532f8b8-e9ee-495b-9e35-adcc16dc46c7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.158395 May 13 12:56:32.145142 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 113/211] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:31 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:32.572719 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dbaa697e-0490-4070-8f65-2c706d078545 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69430ce-2e04-4bb9-bee6-82046a74d9c1"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:32.574388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dbaa697e-0490-4070-8f65-2c706d078545 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:32.580906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbaa697e-0490-4070-8f65-2c706d078545 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:32.582214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbaa697e-0490-4070-8f65-2c706d078545 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:32.583824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbaa697e-0490-4070-8f65-2c706d078545 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:32.584369 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dbaa697e-0490-4070-8f65-2c706d078545 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:32.812296 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:32.813216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:32.831645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:32.832670 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:32.833762 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:32.834331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:32.965483 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dbaa697e-0490-4070-8f65-2c706d078545 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397828 May 13 12:56:32.967224 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 99/212] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:56:32 2022] POST /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:33.042754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:33.051049 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:33.053142 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:33.054314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7887e08f-2f72-4161-a62a-19659e705b1d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.254218 May 13 12:56:33.054876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 114/213] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:32 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:56:33.163350 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:33.164200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:33.171841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:33.172425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:33.173399 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:33.173906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:33.318280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:33.326106 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-947543a4-5b0e-46bc-9925-62c4028c128d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.168285 May 13 12:56:33.326772 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 100/214] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:33 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:34.073600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:34.075380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:34.082230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:34.082896 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:34.084350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:34.084915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:34.240568 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:34.248376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:34.250151 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:34.251335 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-54b96473-4297-4988-b533-7c2f9dadb681 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.183610 May 13 12:56:34.251903 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 115/215] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:34 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:34.343302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:34.343922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:34.350851 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:34.351299 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:34.352057 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:34.352492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:34.486732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:34.500492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a0e7c031-8c20-4ef3-941c-f5d290f87063 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.160900 May 13 12:56:34.501104 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 101/216] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:34 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:35.269891 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:35.270540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:35.276961 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:35.277440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:35.278469 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:35.278910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:35.406502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:35.414722 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:35.416229 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:35.417433 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1f5dc3ba-413c-4d91-b07f-e3f8437a661b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.151404 May 13 12:56:35.417997 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 116/217] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:35 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:35.518115 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:35.518625 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:35.525356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:35.525808 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:35.526608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:35.527053 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:35.657280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:35.665084 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9e5524e7-eda1-4c4d-94ea-dd9a0800839c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.150882 May 13 12:56:35.665648 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 102/218] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:35 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:36.449834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:36.451517 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:36.458662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:36.459338 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:36.460406 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:36.461483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:36.615897 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:36.624496 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:36.626040 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:36.627210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a67e21f4-304e-4f54-9741-250c5a1398f1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.186525 May 13 12:56:36.627781 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 117/219] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:36 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:36.682719 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:36.683402 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:36.689756 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:36.690403 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:36.691181 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:36.691617 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:36.822884 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:36.830262 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-31e67bb7-f1a4-4486-9370-f3e1ce617773 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.151688 May 13 12:56:36.830836 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 103/220] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:36 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:37.646230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:37.647658 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:37.653933 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:37.654982 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:37.655909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:37.656356 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:37.845566 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:37.853325 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:37.855750 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:37.857396 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-54b3afae-975a-4950-8e7b-f981dd7ba081 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.215275 May 13 12:56:37.858496 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 118/221] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:37 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:37.858850 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:37.859517 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:37.876241 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:37.876828 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:37.877666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:37.878265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:38.021520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:38.029608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2774ddfb-8581-4870-b79d-c2f1d65b9ea4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.181603 May 13 12:56:38.030183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 104/222] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:37 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:38.875601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:38.876206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:38.883010 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:38.883499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:38.884424 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:38.884895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:39.020299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:39.029221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:39.030735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:39.031900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5aed5ea5-2197-485f-ab75-94bbdf62191a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.160218 May 13 12:56:39.032459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 119/223] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:38 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:39.047110 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:39.048021 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:39.055065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:39.055520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:39.056294 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:39.056734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:39.192713 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:39.200804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6fc12263-69d0-47f9-b7ab-43c76668e142 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.158050 May 13 12:56:39.201425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 105/224] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:39 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:40.050641 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:40.051254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:40.057759 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.058216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.059082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.059606 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.187254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:40.195829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:40.197364 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:40.198562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5b08bee3-ed76-4c96-bcb0-7cc04a3be123 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.151778 May 13 12:56:40.199824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 120/225] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:40 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:40.218196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:40.218771 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:40.225744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.226196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.227066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.227473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.361247 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:40.368642 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8928a65f-29cb-4b1a-9d78-60ef9b6285b8 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1501 microversion: 2.1 time: 0.154352 May 13 12:56:40.369238 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 106/226] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:40 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:40.385677 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9b06c0c-ecf0-4cfc-8f4a-6888e7e0d7f5"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:40.387801 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:40.393795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.394249 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.395217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.397462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.420380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] HTTP exception thrown: Cannot 'attach_volume' instance b9ff36f5-3afb-4239-b817-663ac72e599f while it is in vm_state rescued May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Request method failure captured: May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: POST /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f/os-volume_attachments HTTP/1.1 May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 74 May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUX6d6ZDKe_nV9YYJJ-Xgg5nq_eQ3qvvcgCeINIKbafVPAIxtWuud204p2x-5jTuIcu4tEnOLvL-XOxslje6BHnGbrbs9z9B_oA_4fgBX5U-tG-0VDQcSFULd0UkNyRJUKeO4CldWqBU_j9rU8l9IFocTMVLdpP7wQR4AMFIFaIgc8 May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 12:56:40.422127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_58bddca6077344bea4cb41b23fcf8d35", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: fbad87a0396f4deb92f4da676af8bfdb May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {"volumeAttachment": {"volumeId": "a9b06c0c-ecf0-4cfc-8f4a-6888e7e0d7f5"}} May 13 12:56:40.423380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Cannot 'attach_volume' instance b9ff36f5-3afb-4239-b817-663ac72e599f while it is in vm_state rescued May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'server_id': 'b9ff36f5-3afb-4239-b817-663ac72e599f', 'body': {'volumeAttachment': {'volumeId': 'a9b06c0c-ecf0-4cfc-8f4a-6888e7e0d7f5'}}} May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b9ff36f5-3afb-4239-b817-663ac72e599f in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:56:40.424159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b9ff36f5-3afb-4239-b817-663ac72e599f while it is in vm_state rescued May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:56:40.425270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:56:40.426257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:56:40.426257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:56:40.426257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b9ff36f5-3afb-4239-b817-663ac72e599f while it is in vm_state rescued May 13 12:56:40.426257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:56:40.427440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Returning 409 to user: Cannot 'attach_volume' instance b9ff36f5-3afb-4239-b817-663ac72e599f while it is in vm_state rescued {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:56:40.428788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ad6e005c-fa89-44e4-8a98-fdc9f127e782 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047168 May 13 12:56:40.429392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 121/227] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:56:40 2022] POST /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 12:56:40.441960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7881cca8-2e87-4ed2-a271-1ac9550c893d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:40.443323 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7881cca8-2e87-4ed2-a271-1ac9550c893d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:40.449451 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7881cca8-2e87-4ed2-a271-1ac9550c893d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.449900 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7881cca8-2e87-4ed2-a271-1ac9550c893d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.450662 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7881cca8-2e87-4ed2-a271-1ac9550c893d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.451093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7881cca8-2e87-4ed2-a271-1ac9550c893d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.522033 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7881cca8-2e87-4ed2-a271-1ac9550c893d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f/action" status: 202 len: 0 microversion: 2.1 time: 0.083693 May 13 12:56:40.525963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 107/228] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:56:40 2022] POST /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:56:40.531785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:40.532408 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:40.539493 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.539947 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.540841 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:40.541314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:40.734796 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:40.742305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-32171c1c-2be7-46a0-9ab5-52e86444240a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1509 microversion: 2.1 time: 0.214950 May 13 12:56:40.742891 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 122/229] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:40 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:41.220024 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:41.220861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:41.228685 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:41.229316 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:41.230633 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:41.231265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:41.376782 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:41.386095 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:41.387923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:41.389313 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d3f469a6-0d27-471c-ae4b-64ec33d44d06 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.173860 May 13 12:56:41.389976 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 108/230] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:41 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:41.548080 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d5df947e-7b9f-4eb7-97cd-b7cd52409b2a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: .version_select at 0x7f06022015e0>, body: {"keypair": {"name": "tempest-keypair-634374857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUhXHBjRAUkjeFVFMPZLrt19vKvaCc4POsQuwqFYUQTYjHBulex9QN9mZJG0yJt4buTLRR3/MRHzTFFeBdAFEl2RCQHOLV1fp6V6b5uOpG5DPF3aGOIRPfXvXXQvAmQow=="}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:41.561547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-d5df947e-7b9f-4eb7-97cd-b7cd52409b2a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:56:41.565279 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-d5df947e-7b9f-4eb7-97cd-b7cd52409b2a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:56:41.588729 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d5df947e-7b9f-4eb7-97cd-b7cd52409b2a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044735 May 13 12:56:41.589521 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 123/231] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 12:56:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:41.759896 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:41.760515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:41.766382 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:41.766842 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:41.767618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:41.768060 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:41.905283 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:41.913618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ad8223a2-c1c8-4367-98cf-19796508f93e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1509 microversion: 2.1 time: 0.157423 May 13 12:56:41.914327 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 109/232] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:41 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:42.408501 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:42.409213 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:42.415791 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:42.416245 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:42.417043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:42.417482 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:42.559151 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:42.569492 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:42.571010 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:42.572191 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fd7c3bfe-ac4d-424e-bd0b-86908e4385de tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.167877 May 13 12:56:42.572772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 124/233] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:42 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:42.902671 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-424307270", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1c41e28-5d16-459f-865e-9320359228db"}], "security_groups": [{"name": "tempest-securitygroup--2108413215"}], "key_name": "tempest-keypair-634374857", "user_data": "}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:42.931124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:42.931928 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:42.938770 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:42.939220 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:42.940135 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:42.940594 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:43.009099 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] validate_networks() for [('f1c41e28-5d16-459f-865e-9320359228db', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:56:43.084675 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:43.092929 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d528438b-c9b8-4793-8c9a-58f9e36ba710 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1509 microversion: 2.1 time: 0.165825 May 13 12:56:43.093524 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 125/234] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:42 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:43.423349 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:56:43.423781 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:56:43.424253 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:56:43.424669 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:56:43.425113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:56:43.433835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:43.434287 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:43.435088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:43.435528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:43.453008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:56:43.457077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:56:43.469210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:56:43.471653 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:56:43.524640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-85459f2f-80fd-4b07-9587-1ae95fc69588 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.626272 May 13 12:56:43.525517 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 110/235] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:56:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 12:56:43.535943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0e0cb34a-aff7-48f1-9daf-d5cfc9bab4bd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:43.537334 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0e0cb34a-aff7-48f1-9daf-d5cfc9bab4bd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:43.591440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:43.592260 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0e0cb34a-aff7-48f1-9daf-d5cfc9bab4bd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:43.592688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:43.598563 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:43.599090 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0e0cb34a-aff7-48f1-9daf-d5cfc9bab4bd tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1240 microversion: 2.1 time: 0.066983 May 13 12:56:43.599246 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:43.599704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 126/236] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:43 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:43.600235 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:43.600792 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:43.736580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:43.745361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:43.746969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:43.748169 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-012fd49a-1462-46a9-b468-1e12d28221c8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.161654 May 13 12:56:43.759111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 111/237] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:43 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:56:44.117305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:44.117916 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:44.124348 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:44.124619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:44.125545 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:44.125993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:44.279896 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:44.289687 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ddd19226-48c5-4fc4-a060-72df723a4030 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1515 microversion: 2.1 time: 0.176509 May 13 12:56:44.291792 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 127/238] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:44 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:44.618036 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:44.618784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:44.628534 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:44.629087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:44.634362 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:44.635125 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:44.710458 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:44.718342 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9e320653-6bd4-4376-b37e-f70216cf9d4c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1300 microversion: 2.1 time: 0.104923 May 13 12:56:44.719539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 112/239] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:44 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:44.766502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:44.767156 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:44.785715 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:44.786698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:44.787787 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:44.788267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:45.269469 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:45.277449 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:45.279214 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:45.280382 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3ca10277-9134-45fd-89bb-e4e41571aa7f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.518156 May 13 12:56:45.280958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 128/240] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:44 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:45.657465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b3c2263a-0d6e-4549-a638-46bd5a5862cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'create', calling method: .version_select at 0x7f06021b9940>, body: {"keypair": {"name": "tempest-keypair-1809250639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEay8/463tReLNK9ufE7B931ty9axO772gCeVVCPJDYIuiUiCOKkMdR+ljbt1TjaURSJhr7wZnuuW+nEcyxWGJVuKOKCTJrJPykaAta7tHajVlyqR2BqIt+6BQCgB4QwSw=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:45.672824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-b3c2263a-0d6e-4549-a638-46bd5a5862cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:56:45.678284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-b3c2263a-0d6e-4549-a638-46bd5a5862cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for user fbad87a0396f4deb92f4da676af8bfdb and project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:56:45.704942 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b3c2263a-0d6e-4549-a638-46bd5a5862cf tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051523 May 13 12:56:45.705815 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 113/241] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 12:56:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:45.736064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:45.736690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:45.743431 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:45.744149 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:45.745258 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:45.746020 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:45.842012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:45.851232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d18c1e1a-55d3-457a-a92c-988711a3bcc2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1298 microversion: 2.1 time: 0.119313 May 13 12:56:45.852113 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 129/242] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:45 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:46.299367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:46.299960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:46.308469 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:46.309369 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:46.310466 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:46.311858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:46.492844 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:46.501091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:46.502924 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:46.504508 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6a7055e4-39fe-45e2-a072-5d73037871e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.209685 May 13 12:56:46.518000 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 114/243] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:46 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:46.900020 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:46.900648 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:46.916376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:46.917494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:46.918710 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:46.924098 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:47.263558 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:47.284154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-053bab0d-ff0c-4e45-a745-79c988133469 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.419379 May 13 12:56:47.285200 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 130/244] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:46 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:47.347093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-07e0734e-2fe2-4ac7-9f40-90eed3eec64d req-91872d35-602c-4440-8fe2-67e176981540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b7e01b-70b1-46a0-96f0-1c412e18c5e1", "tag": "6131eae9-947c-4782-958f-bf729b85fce7"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:47.378041 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-07e0734e-2fe2-4ac7-9f40-90eed3eec64d req-91872d35-602c-4440-8fe2-67e176981540 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:47.378857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-07e0734e-2fe2-4ac7-9f40-90eed3eec64d req-91872d35-602c-4440-8fe2-67e176981540 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:47.397096 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-07e0734e-2fe2-4ac7-9f40-90eed3eec64d req-91872d35-602c-4440-8fe2-67e176981540 service nova] Creating event network-changed:6131eae9-947c-4782-958f-bf729b85fce7 for instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 on hv-cinder-84164 May 13 12:56:47.404750 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-07e0734e-2fe2-4ac7-9f40-90eed3eec64d req-91872d35-602c-4440-8fe2-67e176981540 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062416 May 13 12:56:47.407068 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 115/245] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:47.529169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:47.549909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:47.559330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:47.560211 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:47.561330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:47.562246 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:47.849484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:47.861156 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:47.864543 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:47.865956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c0225117-3db9-47b4-b790-30fbfd3483ae tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.344437 May 13 12:56:47.867362 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 131/246] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:47 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:56:48.304104 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:48.304938 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:48.311993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:48.312572 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:48.313554 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:48.314328 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:48.433934 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2103635549", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f576fff5-2fa1-4591-9247-28b4216fb188"}], "security_groups": [{"name": "tempest-securitygroup--702212299"}], "key_name": "tempest-keypair-1809250639", "user_data": "}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:48.496869 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:48.504797 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4812936f-033c-43f8-9419-428b4b3143b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.205986 May 13 12:56:48.506328 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 116/247] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:48 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:48.549385 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] validate_networks() for [('f576fff5-2fa1-4591-9247-28b4216fb188', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:56:48.886118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:48.886729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:48.893143 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:48.893599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:48.894413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:48.894849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:48.929510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:56:48.929931 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:56:48.930404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:56:48.930809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:56:48.931212 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:56:48.940088 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:48.940532 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:48.941369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:48.941804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:48.959028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:56:48.962990 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Getting quotas for user fbad87a0396f4deb92f4da676af8bfdb and project 58bddca6077344bea4cb41b23fcf8d35. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:56:48.976552 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:56:48.978557 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:56:49.026276 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f3979f6b-1d38-46ed-883f-cb1b41ac3295 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.596564 May 13 12:56:49.029016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 132/248] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:56:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 12:56:49.039013 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2a2abf95-7a5d-44d2-a6bc-162883a438c4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:49.039634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2a2abf95-7a5d-44d2-a6bc-162883a438c4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:49.040418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:49.048802 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:49.050736 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:49.052913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f20a67f5-bdc9-4bb9-82b9-93f51cfe0583 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1744 microversion: 2.20 time: 0.170763 May 13 12:56:49.061179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 117/249] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:48 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:56:49.094517 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2a2abf95-7a5d-44d2-a6bc-162883a438c4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:49.101996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2a2abf95-7a5d-44d2-a6bc-162883a438c4 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1246 microversion: 2.1 time: 0.068410 May 13 12:56:49.102859 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 133/250] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:49 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:49.523082 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:49.524294 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:49.531691 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:49.532591 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:49.533697 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:49.534315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:49.687538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:49.699146 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-afd6526e-3ec1-4036-a862-6366e315dc02 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.180250 May 13 12:56:49.701476 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 118/251] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:49 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:50.071679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:50.072314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:50.078786 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:50.079228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:50.080019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:50.080450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:50.119639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:50.120256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:50.126040 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:50.126488 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:50.127252 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:50.127689 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:50.188254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:50.197842 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1ac4a0c5-c5b4-419e-a985-8a59bce6c602 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1298 microversion: 2.1 time: 0.082002 May 13 12:56:50.198432 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 119/252] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:50 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:50.263960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:50.272813 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:50.274569 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:50.275894 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8de5bc53-c8e0-4c47-8a52-ed94ef691dea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1744 microversion: 2.20 time: 0.208096 May 13 12:56:50.278699 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 134/253] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:50 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:50.718404 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:50.719133 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:50.726186 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:50.726642 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:50.727418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:50.727858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:50.935131 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:50.943129 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fd412e28-16b1-414d-9f4a-fdaabc1768d2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.228415 May 13 12:56:50.943722 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 120/254] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:50 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:51.215116 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:51.215861 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:51.221944 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:51.222419 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:51.223206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:51.223793 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:51.297606 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:51.299179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:51.322328 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:51.323287 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:51.324254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:51.324854 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:51.373915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:51.382340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1a4f1f43-b6e5-415d-ab7e-be90e06592af tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.170995 May 13 12:56:51.383054 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 135/255] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:51 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:51.532690 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:51.547193 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:51.548914 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:51.550338 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-72d795f9-e5ca-4049-ae38-8753a4ae1de7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1744 microversion: 2.20 time: 0.258832 May 13 12:56:51.551410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 121/256] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:51 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:51.888819 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-13d242a6-85e7-4a74-a809-5afac995de8b req-0f1001d2-67b5-4606-83b8-ec50bddcb542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83873f65-ba42-4536-9af6-4aff1db77bb4", "name": "network-vif-plugged", "status": "completed", "tag": "312207b7-e73e-4ced-8336-af184bb733a6"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:51.897754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-13d242a6-85e7-4a74-a809-5afac995de8b req-0f1001d2-67b5-4606-83b8-ec50bddcb542 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:51.898198 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-13d242a6-85e7-4a74-a809-5afac995de8b req-0f1001d2-67b5-4606-83b8-ec50bddcb542 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:51.914478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-13d242a6-85e7-4a74-a809-5afac995de8b req-0f1001d2-67b5-4606-83b8-ec50bddcb542 service nova] Creating event network-vif-plugged:312207b7-e73e-4ced-8336-af184bb733a6 for instance 83873f65-ba42-4536-9af6-4aff1db77bb4 on hv-cinder-84164 May 13 12:56:51.923723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-13d242a6-85e7-4a74-a809-5afac995de8b req-0f1001d2-67b5-4606-83b8-ec50bddcb542 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037824 May 13 12:56:51.924583 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 136/257] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:51.966798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:51.967421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:51.978008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:51.978727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:51.980028 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:51.980628 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:52.182697 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-d91c905f-6f17-4334-99e9-535ce941b95e req-c66129ce-e8c7-4bab-9e12-5f72847c2cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d6f955-cec3-41be-b4c3-c1ab08771e24", "tag": "c221412b-60f8-4ab0-b29a-df7ab68bd041"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:52.201876 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:52.203069 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-d91c905f-6f17-4334-99e9-535ce941b95e req-c66129ce-e8c7-4bab-9e12-5f72847c2cdc service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:52.203811 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-d91c905f-6f17-4334-99e9-535ce941b95e req-c66129ce-e8c7-4bab-9e12-5f72847c2cdc service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:52.211639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dcc9412f-3187-4ca3-8127-dd40f414da6d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.255718 May 13 12:56:52.213125 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 122/258] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:51 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:52.226892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-d91c905f-6f17-4334-99e9-535ce941b95e req-c66129ce-e8c7-4bab-9e12-5f72847c2cdc service nova] Creating event network-changed:c221412b-60f8-4ab0-b29a-df7ab68bd041 for instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 on hv-cinder-84164 May 13 12:56:52.231903 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-d91c905f-6f17-4334-99e9-535ce941b95e req-c66129ce-e8c7-4bab-9e12-5f72847c2cdc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053257 May 13 12:56:52.232816 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 137/259] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:56:52.400422 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:52.401058 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:52.407374 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:52.407835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:52.408612 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:52.409077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:52.575273 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:52.576123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:52.582659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:52.583485 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:52.584378 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:52.584883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:52.643540 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:52.652721 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-08eb71af-51d7-4172-a59f-1228d1764c0a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.256440 May 13 12:56:52.663792 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 123/260] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:52 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:52.747249 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:52.755608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:52.757547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:52.759261 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0f60f864-83a6-4c9e-85c6-e8a88af8b75a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.189509 May 13 12:56:52.759261 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 138/261] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:52 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:53.229167 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:53.229789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:53.236380 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:53.236843 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:53.237639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:53.238079 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:53.371101 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:53.384037 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8b37bb34-ec57-4a3c-a68c-bc803ba1a8a5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.158688 May 13 12:56:53.385580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 124/262] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:53 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:53.670957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:53.672581 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:53.679294 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:53.679748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:53.680529 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:53.680972 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:53.776955 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:53.779095 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:53.785014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:53.785475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:53.787812 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:53.788406 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:53.821775 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:53.829813 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2bbb2c42-2b81-4e8f-b000-d7903673b93f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.162732 May 13 12:56:53.832428 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 139/263] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:53 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:53.941284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-23eb80de-9c79-481d-9e5d-0cfe42825d9f req-5240e783-b6e5-4b4d-8fc8-add0551c0fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b7e01b-70b1-46a0-96f0-1c412e18c5e1", "name": "network-vif-plugged", "status": "completed", "tag": "6131eae9-947c-4782-958f-bf729b85fce7"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:53.943353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:53.950702 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-23eb80de-9c79-481d-9e5d-0cfe42825d9f req-5240e783-b6e5-4b4d-8fc8-add0551c0fb4 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:53.951407 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-23eb80de-9c79-481d-9e5d-0cfe42825d9f req-5240e783-b6e5-4b4d-8fc8-add0551c0fb4 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:53.953384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:53.954887 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:53.956179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c63f05f1-5bb9-4328-a188-4230a510976c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.183002 May 13 12:56:53.958200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 125/264] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:53 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:56:53.972071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-23eb80de-9c79-481d-9e5d-0cfe42825d9f req-5240e783-b6e5-4b4d-8fc8-add0551c0fb4 service nova] Creating event network-vif-plugged:6131eae9-947c-4782-958f-bf729b85fce7 for instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 on hv-cinder-84164 May 13 12:56:53.979508 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-23eb80de-9c79-481d-9e5d-0cfe42825d9f req-5240e783-b6e5-4b4d-8fc8-add0551c0fb4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042253 May 13 12:56:53.980466 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 140/265] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:56:54.401670 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:54.402281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:54.420573 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.422276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:54.425155 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.425726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:54.435070 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2d6620e1-5efa-47b5-9e56-66442ae7707f tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:54.435922 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2d6620e1-5efa-47b5-9e56-66442ae7707f tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:54.447243 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d6620e1-5efa-47b5-9e56-66442ae7707f tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.447960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d6620e1-5efa-47b5-9e56-66442ae7707f tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:54.450839 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d6620e1-5efa-47b5-9e56-66442ae7707f tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.452803 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d6620e1-5efa-47b5-9e56-66442ae7707f tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:54.507466 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2d6620e1-5efa-47b5-9e56-66442ae7707f tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/ips" status: 200 len: 147 microversion: 2.1 time: 0.076762 May 13 12:56:54.511039 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 141/266] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 12:56:54 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/ips => generated 147 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:54.680013 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:54.687803 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-14dc0e37-03b3-4730-8e39-0f323d22f240 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.289893 May 13 12:56:54.701697 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 126/267] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:54 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:54.848240 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:54.849944 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:54.873006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.873524 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:54.874401 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.874840 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:54.977602 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:54.980337 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:54.991299 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.991948 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:54.993213 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:54.993872 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:55.062272 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:55.080929 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0dedceb3-9d9e-46fe-aa79-f0db6f99ac95 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.237055 May 13 12:56:55.082028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 142/268] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:54 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:55.193955 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:55.204817 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:55.206603 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:55.208013 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b97aff93-5cfd-46c6-9d0d-49ff09241042 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.236335 May 13 12:56:55.208737 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 127/269] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:54 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:56:55.706560 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:55.707177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:55.714982 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:55.715782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:55.718497 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:55.719311 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:55.941443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:55.977450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d2027eff-d3b4-4676-a4ca-c1d88519ab4a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1366 microversion: 2.1 time: 0.274629 May 13 12:56:55.978878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 143/270] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:55 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:56.099577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:56.100182 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:56.110795 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:56.111352 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:56.112112 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:56.112633 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:56.231189 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:56.232128 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:56.243496 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:56.244277 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:56.245376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:56.245820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:56.299247 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:56.323146 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-09e578a1-c876-4ceb-9c49-35bf1ea3395f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.227503 May 13 12:56:56.338256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 128/271] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:56 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:56:56.395459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:56.405560 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:56.407716 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:56.409110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b5922608-dd5b-47b9-8016-1df77c860bbf tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.186508 May 13 12:56:56.421223 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 144/272] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:56 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:56.997562 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:56.998450 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:57.007510 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.008326 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.009279 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.009802 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.153369 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:57.164299 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9d37173c-4815-4528-8de0-c4afd2e83d6f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1555 microversion: 2.1 time: 0.171051 May 13 12:56:57.164883 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 129/273] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:56 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:57.181399 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-85864238-7463-4df8-bf31-5070df6e8f4e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:57.182578 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-85864238-7463-4df8-bf31-5070df6e8f4e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:57.189149 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-85864238-7463-4df8-bf31-5070df6e8f4e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.189687 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-85864238-7463-4df8-bf31-5070df6e8f4e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.190536 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-85864238-7463-4df8-bf31-5070df6e8f4e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.191025 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-85864238-7463-4df8-bf31-5070df6e8f4e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.273548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-85864238-7463-4df8-bf31-5070df6e8f4e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096026 May 13 12:56:57.275230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 145/274] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:56:57 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:57.354142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:57.354758 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:57.365861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.366670 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.367548 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.368060 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.428871 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:57.428871 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:57.434934 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.435395 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.436171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.436614 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.576842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:57.585184 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:57.586727 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:57.588483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4de45ad4-a7f6-49bf-b6df-1c413d20ae10 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.164707 May 13 12:56:57.600046 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 146/275] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:57 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:57.642853 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:57.657865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-afc2e5b8-0da0-4206-935a-696669011245 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.307052 May 13 12:56:57.671129 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 130/276] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:57 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:57.814255 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-9227e27a-6a5b-449d-a928-cfbf0351641e req-30aa2895-b069-4d26-b6e2-a254fc4a9a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d6f955-cec3-41be-b4c3-c1ab08771e24", "name": "network-vif-plugged", "status": "completed", "tag": "c221412b-60f8-4ab0-b29a-df7ab68bd041"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:57.830304 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9227e27a-6a5b-449d-a928-cfbf0351641e req-30aa2895-b069-4d26-b6e2-a254fc4a9a98 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:57.835286 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9227e27a-6a5b-449d-a928-cfbf0351641e req-30aa2895-b069-4d26-b6e2-a254fc4a9a98 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:57.863715 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-9227e27a-6a5b-449d-a928-cfbf0351641e req-30aa2895-b069-4d26-b6e2-a254fc4a9a98 service nova] Creating event network-vif-plugged:c221412b-60f8-4ab0-b29a-df7ab68bd041 for instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 on hv-cinder-84164 May 13 12:56:57.880652 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-9227e27a-6a5b-449d-a928-cfbf0351641e req-30aa2895-b069-4d26-b6e2-a254fc4a9a98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069991 May 13 12:56:57.881870 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 147/277] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:56:58.618378 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:58.622379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:58.632406 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:58.633250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:58.634295 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:58.634803 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:58.680014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:58.680717 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:58.687452 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:58.687977 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:58.688787 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:58.689254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:58.837287 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:58.844866 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1e722aee-f88d-4b24-8f40-e1475c75b6fa tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.169626 May 13 12:56:58.847332 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 148/278] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:58 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:56:58.907243 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:58.918858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:58.921775 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:56:58.922974 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fc257cd8-ba93-4f60-a8b6-f88fdd542c5a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.320241 May 13 12:56:58.927122 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 131/279] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:56:58 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:56:59.107603 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-6c2935df-9fb3-4c49-a8da-bcb19820dc60 req-233c96e2-23e1-423b-90c5-1d6ec23b2d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b7e01b-70b1-46a0-96f0-1c412e18c5e1", "tag": "6131eae9-947c-4782-958f-bf729b85fce7"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:59.116972 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-6c2935df-9fb3-4c49-a8da-bcb19820dc60 req-233c96e2-23e1-423b-90c5-1d6ec23b2d00 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:59.117457 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-6c2935df-9fb3-4c49-a8da-bcb19820dc60 req-233c96e2-23e1-423b-90c5-1d6ec23b2d00 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:59.132495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-6c2935df-9fb3-4c49-a8da-bcb19820dc60 req-233c96e2-23e1-423b-90c5-1d6ec23b2d00 service nova] Creating event network-changed:6131eae9-947c-4782-958f-bf729b85fce7 for instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 on hv-cinder-84164 May 13 12:56:59.138515 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-6c2935df-9fb3-4c49-a8da-bcb19820dc60 req-233c96e2-23e1-423b-90c5-1d6ec23b2d00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035364 May 13 12:56:59.139557 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 149/280] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:56:59.567015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-471dc790-e8d9-4e6d-8166-6eafa1703667 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d2d0296-55dc-441d-93ca-c70b4e7eafdd"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:56:59.568975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-471dc790-e8d9-4e6d-8166-6eafa1703667 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:59.589787 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-471dc790-e8d9-4e6d-8166-6eafa1703667 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:59.590673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-471dc790-e8d9-4e6d-8166-6eafa1703667 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:59.591778 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-471dc790-e8d9-4e6d-8166-6eafa1703667 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:59.592446 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-471dc790-e8d9-4e6d-8166-6eafa1703667 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:59.864416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:56:59.865350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:56:59.871598 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:59.872056 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:56:59.872834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:56:59.873304 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:00.041477 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:00.053394 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6e738abc-5c88-4c87-a178-2ec247f9b525 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1371 microversion: 2.1 time: 0.193111 May 13 12:57:00.081225 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 150/281] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:56:59 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:00.088112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:00.088902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:00.096217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:00.097255 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:00.100240 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:00.100880 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:00.310861 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:00.320181 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:00.327474 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:00.329462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6e0b47ce-b07b-48e8-93b4-1d597d09fc7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.246393 May 13 12:57:00.330679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 151/282] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:00 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:00.834171 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-471dc790-e8d9-4e6d-8166-6eafa1703667 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.272907 May 13 12:57:00.835102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 132/283] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:56:59 2022] POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-volume_attachments => generated 194 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:01.072572 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:01.074349 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:01.081532 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:01.082232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:01.084417 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:01.085236 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:01.296805 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:01.311085 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8f9710eb-4bd7-4283-93a6-e6ee71ee4e79 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1564 microversion: 2.1 time: 0.244174 May 13 12:57:01.312759 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 152/284] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:01 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1564 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:01.333827 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a4db719a-609c-4ce9-8b74-dfceba266b46 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:01.334402 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a4db719a-609c-4ce9-8b74-dfceba266b46 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:01.340670 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a4db719a-609c-4ce9-8b74-dfceba266b46 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:01.341182 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a4db719a-609c-4ce9-8b74-dfceba266b46 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:01.341968 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a4db719a-609c-4ce9-8b74-dfceba266b46 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:01.343674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a4db719a-609c-4ce9-8b74-dfceba266b46 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:01.351155 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:01.351780 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:01.362414 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:01.362889 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:01.363749 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:01.364848 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:01.454499 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a4db719a-609c-4ce9-8b74-dfceba266b46 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126842 May 13 12:57:01.462039 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 133/285] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:57:01 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:01.575569 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:01.584339 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:01.592121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:01.599127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-713417c6-8dbb-4f79-822a-9ba2859ed51e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.253810 May 13 12:57:01.600800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 153/286] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:01 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:57:02.627274 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:02.628615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:02.636585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:02.637382 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:02.638829 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:02.639466 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:02.674115 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-7cb5b24e-2f8d-407b-a82e-ef5ee05ae8df req-f7c614e6-f205-40a9-be50-87cd88f0d9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d6f955-cec3-41be-b4c3-c1ab08771e24", "tag": "c221412b-60f8-4ab0-b29a-df7ab68bd041"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:02.702184 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-7cb5b24e-2f8d-407b-a82e-ef5ee05ae8df req-f7c614e6-f205-40a9-be50-87cd88f0d9e5 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:02.710286 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-7cb5b24e-2f8d-407b-a82e-ef5ee05ae8df req-f7c614e6-f205-40a9-be50-87cd88f0d9e5 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:02.728696 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-7cb5b24e-2f8d-407b-a82e-ef5ee05ae8df req-f7c614e6-f205-40a9-be50-87cd88f0d9e5 service nova] Creating event network-changed:c221412b-60f8-4ab0-b29a-df7ab68bd041 for instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 on hv-cinder-84164 May 13 12:57:02.737605 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-7cb5b24e-2f8d-407b-a82e-ef5ee05ae8df req-f7c614e6-f205-40a9-be50-87cd88f0d9e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069635 May 13 12:57:02.740182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 154/287] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:02.955613 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:02.969549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:02.971983 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:02.973474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0a52be7e-9292-4509-9f1d-ecf961fe1925 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.353858 May 13 12:57:02.974832 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 134/288] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:02 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:03.994316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:03.995104 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:04.006603 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:04.007705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:04.008693 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:04.009233 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:04.157072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:04.175892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:04.177907 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:04.179147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a04ca583-3d79-4ed9-9dba-3aa396063fea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1739 microversion: 2.20 time: 0.190778 May 13 12:57:04.179780 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 155/289] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:03 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:05.197688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:05.198434 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:05.204684 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:05.205204 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:05.205981 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:05.206448 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:05.403962 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:05.411652 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:05.413349 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:05.414516 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f95f6147-6665-47eb-8d78-f6a90118790c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1721 microversion: 2.20 time: 0.221237 May 13 12:57:05.415083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 135/290] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:05 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:06.432895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:06.433537 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:06.439443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:06.439892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:06.440670 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:06.441123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:06.568461 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:06.576679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:06.578213 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:06.579353 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-bd31fb36-94d9-44e4-8b73-57e05bcfc6b6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1721 microversion: 2.20 time: 0.150403 May 13 12:57:06.579909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 156/291] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:06 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:07.598163 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:07.598781 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:07.605443 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:07.605899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:07.606671 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:07.607111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:07.701820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-fb3ab377-84e8-47fe-88ab-ca7918f9ab84 req-e042c8e9-abe0-4ba2-b93c-f0455cffc4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83873f65-ba42-4536-9af6-4aff1db77bb4", "name": "network-vif-unplugged", "status": "completed", "tag": "312207b7-e73e-4ced-8336-af184bb733a6"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:07.709853 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-fb3ab377-84e8-47fe-88ab-ca7918f9ab84 req-e042c8e9-abe0-4ba2-b93c-f0455cffc4c8 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:07.710713 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-fb3ab377-84e8-47fe-88ab-ca7918f9ab84 req-e042c8e9-abe0-4ba2-b93c-f0455cffc4c8 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:07.722016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-fb3ab377-84e8-47fe-88ab-ca7918f9ab84 req-e042c8e9-abe0-4ba2-b93c-f0455cffc4c8 service nova] Creating event network-vif-unplugged:312207b7-e73e-4ced-8336-af184bb733a6 for instance 83873f65-ba42-4536-9af6-4aff1db77bb4 on hv-cinder-84164 May 13 12:57:07.728004 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-fb3ab377-84e8-47fe-88ab-ca7918f9ab84 req-e042c8e9-abe0-4ba2-b93c-f0455cffc4c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029764 May 13 12:57:07.728836 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 157/292] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:57:07.736569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:07.745750 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:07.747257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:07.748433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-56a2b196-b490-42c9-8ceb-6caf9e7f0995 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1721 microversion: 2.20 time: 0.154190 May 13 12:57:07.749021 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 136/293] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:07 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:08.768153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:08.768852 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:08.775358 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:08.776055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:08.777160 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:08.777824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:08.927525 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:08.937136 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:08.938956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:08.940600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-eff0bfb1-54bf-4dd6-a1a8-66a247e6f65f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1724 microversion: 2.20 time: 0.176573 May 13 12:57:08.941253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 158/294] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:08 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:08.958290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-38cfe5a5-48ee-4217-93d8-57b760b44034 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fee88bac-60f4-4ddb-94c0-b703d8350c43"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:08.960172 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-38cfe5a5-48ee-4217-93d8-57b760b44034 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:08.966889 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-38cfe5a5-48ee-4217-93d8-57b760b44034 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:08.967342 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-38cfe5a5-48ee-4217-93d8-57b760b44034 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:08.968149 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-38cfe5a5-48ee-4217-93d8-57b760b44034 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:08.968585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-38cfe5a5-48ee-4217-93d8-57b760b44034 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.234544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-38cfe5a5-48ee-4217-93d8-57b760b44034 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280264 May 13 12:57:09.235256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 137/295] 10.222.0.49 () {62 vars in 1363 bytes} [Fri May 13 12:57:08 2022] POST /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:57:09.349120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3e9b2e28-c07d-418b-b2e5-616b06588f6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:09.349703 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3e9b2e28-c07d-418b-b2e5-616b06588f6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:09.356604 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3e9b2e28-c07d-418b-b2e5-616b06588f6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:09.357086 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3e9b2e28-c07d-418b-b2e5-616b06588f6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.357865 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3e9b2e28-c07d-418b-b2e5-616b06588f6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:09.358334 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3e9b2e28-c07d-418b-b2e5-616b06588f6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.466431 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3e9b2e28-c07d-418b-b2e5-616b06588f6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/action" status: 202 len: 0 microversion: 2.20 time: 0.121261 May 13 12:57:09.469958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 159/296] 10.222.0.49 () {62 vars in 1318 bytes} [Fri May 13 12:57:09 2022] POST /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 12:57:09.475271 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:09.476078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:09.487889 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:09.488515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.489518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:09.490237 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.493449 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b2b66a6e-8c69-4380-b912-dda6ae702b44 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:09.503351 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2b66a6e-8c69-4380-b912-dda6ae702b44 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:09.503816 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2b66a6e-8c69-4380-b912-dda6ae702b44 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.567579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b2b66a6e-8c69-4380-b912-dda6ae702b44 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Going to try to stop instance {{(pid=123410) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 12:57:09.613533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b2b66a6e-8c69-4380-b912-dda6ae702b44 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action" status: 202 len: 0 microversion: 2.1 time: 0.124079 May 13 12:57:09.614367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 160/297] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:57:09 2022] POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 12:57:09.623053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:09.623731 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:09.629883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:09.630330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.631615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:09.632051 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:09.640486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:09.650631 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:09.656689 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:09.658177 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3847b7f8-c921-46a7-8f6a-6c6f6dc90b60 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1750 microversion: 2.20 time: 0.186779 May 13 12:57:09.658754 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 138/298] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:09 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:57:09.770384 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:09.779204 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e3b7f783-ccbc-4a88-a0a6-d0d5efd55d40 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.159853 May 13 12:57:09.779789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 161/299] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:09 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:10.676960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:10.677602 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:10.684372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:10.684822 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:10.685652 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:10.686095 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:10.797658 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:10.798281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:10.804912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:10.805450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:10.806228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:10.806668 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:10.818551 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:10.827311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:10.828801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:10.829990 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9e449800-7804-4e03-bc92-f58f76ff3170 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1752 microversion: 2.20 time: 0.156920 May 13 12:57:10.830551 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 139/300] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:10 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:10.934088 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:10.942087 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a185e050-818e-4483-b344-1c92469077ac tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.148295 May 13 12:57:10.942661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 162/301] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:10 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:11.849379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:11.849916 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:11.856803 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:11.857305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:11.858087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:11.858533 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:11.959053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:11.959691 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:11.966537 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:11.966984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:11.967761 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:11.968191 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:12.071315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:12.080854 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:12.082416 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:12.083594 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8676f28b-bfba-4cfe-a21e-91972336c54a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.238232 May 13 12:57:12.084161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 140/302] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:11 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:12.097991 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:12.106441 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-40d68319-41b5-4e7b-b616-23dca1f3f3ef tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.151081 May 13 12:57:12.106956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 163/303] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:11 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:13.103479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:13.104089 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:13.110501 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:13.110954 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:13.111743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:13.112182 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:13.124081 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:13.124695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:13.130573 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:13.131027 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:13.131831 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:13.132359 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:13.252217 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:13.262251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:13.266268 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:13.267660 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4eb105c5-d9ec-4efc-b1ec-eb90f4c73fa3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.168585 May 13 12:57:13.268381 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 141/304] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:13 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:13.287950 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:13.299552 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-74f0a8c9-f793-4aac-9d8b-7b8087d6c2b1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.179128 May 13 12:57:13.299986 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 164/305] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:13 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:14.289395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:14.290011 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:14.296614 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:14.297102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:14.298025 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:14.298482 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:14.318679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:14.319431 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:14.336780 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:14.339495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:14.340508 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:14.341173 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:14.442448 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:14.452517 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:14.454742 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:14.456010 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f76f0c4e-635f-4829-9916-3de08c521ffc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.172219 May 13 12:57:14.456581 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 142/306] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:14 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:14.493043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:14.504430 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d3dec59f-76de-4f12-84ea-c4048ce351d5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.189393 May 13 12:57:14.505478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 165/307] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:14 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:15.475701 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:15.476828 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:15.483855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:15.484318 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:15.485276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:15.486140 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:15.523419 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:15.524280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:15.531630 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:15.532201 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:15.533128 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:15.533630 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:15.658700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:15.667903 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:15.670012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:15.671452 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e6378b3a-e48f-46be-8e71-a6a354100f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.199706 May 13 12:57:15.683184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 143/308] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:15 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:15.698423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:15.706828 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-244c1886-9899-4140-94f0-998716b1971e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.187983 May 13 12:57:15.707490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 166/309] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:15 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:16.690840 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:16.691453 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:16.697919 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:16.698370 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:16.699136 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:16.699614 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:16.724101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:16.724719 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:16.731597 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:16.732257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:16.733281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:16.733844 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:16.845993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:16.855481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:16.856998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:16.858175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fd1635a4-1357-4777-a9ab-432b0c84f8c6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.171282 May 13 12:57:16.860141 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 144/310] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:16 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:16.885512 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:16.888965 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c07b9869-6c9a-4954-a552-1c0a02434ff4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.168844 May 13 12:57:16.889624 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 167/311] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:16 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:17.876014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:17.876612 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:17.883978 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:17.885663 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:17.886502 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:17.886946 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:17.908119 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:17.908744 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:17.915887 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:17.916336 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:17.917165 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:17.917596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:18.042351 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:18.051887 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:18.053449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:18.054997 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-898bb80e-4860-4646-8401-3bdd13e23bdb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.183065 May 13 12:57:18.055569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 145/312] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:17 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:18.080188 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:18.088702 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-835c362f-f20a-420f-81ec-aa7ba12284f0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.184839 May 13 12:57:18.089341 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 168/313] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:17 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:19.074275 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:19.074873 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:19.081237 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:19.081698 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:19.082454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:19.082889 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:19.106363 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:19.106964 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:19.113035 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:19.113498 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:19.114289 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:19.114733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:19.230342 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:19.240862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:19.243320 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:19.244802 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-32fb1401-e2b8-4cab-bae4-d633ae0f685f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.175482 May 13 12:57:19.256413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 146/314] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:19 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:19.262288 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:19.270793 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-61a239f5-14dd-42b0-bf73-191d7edb1eb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.168247 May 13 12:57:19.281539 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 169/315] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:19 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:20.264463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:20.265195 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:20.271643 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:20.272435 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:20.274372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:20.274372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:20.289837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:20.290446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:20.296551 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:20.297697 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:20.297888 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:20.298929 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:20.458046 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:20.465549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:20.468557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:20.470608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:20.471868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-834b6f44-6d61-468d-8ae2-1ea1033a8657 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.211409 May 13 12:57:20.474494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e79e98d2-e688-491e-b757-e69c232ea5c9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.189072 May 13 12:57:20.480914 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 147/316] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:20 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:20.481882 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 170/317] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:20 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:21.491400 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:21.492215 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:21.494256 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:21.494958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:21.499671 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:21.500123 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:21.500916 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:21.501388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:21.502284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:21.502742 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:21.503525 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:21.504170 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:21.658989 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:21.660905 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:21.668865 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f84475ca-9f52-4c4c-b87f-abb42abd085e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.179454 May 13 12:57:21.670318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 171/318] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:21 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:21.671258 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:21.672768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:21.673963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-49904878-a450-437e-8917-54c109772886 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.186688 May 13 12:57:21.674641 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 148/319] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:21 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:22.686452 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:22.687103 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:22.691953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:22.692695 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:22.693073 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:22.693530 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:22.694309 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:22.694876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:22.699298 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:22.699753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:22.700522 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:22.700956 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:22.822420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:22.827804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:22.830547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6a76a1ca-e8da-4403-88b3-3e2b4a3780dc tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1725 microversion: 2.1 time: 0.148172 May 13 12:57:22.831349 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 172/320] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:22 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:22.836931 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:22.838479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:22.839640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e06c44ef-f181-46d6-8f35-7bbc57e00c7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.151574 May 13 12:57:22.840189 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 149/321] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:22 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:57:23.848114 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:23.848731 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:23.856429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:23.857045 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:23.858151 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:23.858466 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:23.858901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:23.859077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:23.866073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:23.866567 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:23.867384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:23.868393 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:23.991962 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:24.001523 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5373c481-7fa4-47f3-8751-c6c0ff1dfb69 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1702 microversion: 2.1 time: 0.157268 May 13 12:57:24.002106 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 173/322] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:23 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:24.017698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-50b0ac7c-fdb3-418c-856a-cf83d5b4a4f1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:24.024096 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-50b0ac7c-fdb3-418c-856a-cf83d5b4a4f1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:24.024548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-50b0ac7c-fdb3-418c-856a-cf83d5b4a4f1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:24.047399 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-50b0ac7c-fdb3-418c-856a-cf83d5b4a4f1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Going to try to start instance {{(pid=123410) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 12:57:24.086468 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:24.090855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-50b0ac7c-fdb3-418c-856a-cf83d5b4a4f1 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action" status: 202 len: 0 microversion: 2.1 time: 0.076672 May 13 12:57:24.094528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 174/323] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:57:24 2022] POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 12:57:24.098818 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:24.100835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:24.101841 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:24.102622 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a0c42b4e-b2e1-4dbf-8edc-7479e28fd5d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.248221 May 13 12:57:24.102862 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:24.109857 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:24.110438 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:24.111236 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:24.111735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:24.114079 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 150/324] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:23 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:24.243420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:24.251752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3a1c5675-9b6f-42cf-9416-fcf3b9830485 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1711 microversion: 2.1 time: 0.155215 May 13 12:57:24.252548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 175/325] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:24 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:25.121087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:25.121707 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:25.128043 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:25.128497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:25.129412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:25.129850 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:25.256772 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:25.265522 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:25.267024 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:25.268190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b709edb6-3a5f-4906-8c99-26bdebf10467 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.151672 May 13 12:57:25.268751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 151/326] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:25 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:25.269211 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:25.269832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:25.275893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:25.276347 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:25.277402 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:25.277845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:25.462696 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:25.472526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6ea99124-2f5a-4c5e-8183-329730f0de62 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1711 microversion: 2.1 time: 0.207109 May 13 12:57:25.482520 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 176/327] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:25 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1711 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:57:26.286262 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:26.286882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:26.293998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:26.294450 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:26.295218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:26.295656 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:26.422661 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:26.431047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:26.432550 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:26.433750 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-597ee3ad-ccdc-4e99-a266-d47474f5d92e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.151497 May 13 12:57:26.434312 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 152/328] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:26 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:26.490250 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:26.490861 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:26.496947 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:26.497423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:26.498180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:26.498610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:26.627110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:26.635313 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-138271fb-edf0-4b14-b81b-381594ad5007 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1711 microversion: 2.1 time: 0.148850 May 13 12:57:26.635879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 177/329] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:26 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1711 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:27.451723 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:27.452333 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:27.458683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:27.459133 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:27.459891 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:27.460327 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:27.584262 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:27.592340 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:27.593857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:27.595000 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0ec2b245-4f88-4d5e-95be-a03d6ab3f59a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.147181 May 13 12:57:27.595556 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 153/330] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:27 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:27.652238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:27.652858 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:27.659029 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:27.659483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:27.660253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:27.660694 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:27.786238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:27.794657 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3b50e4ce-0f7c-46d7-9f19-5d0b3a1d0785 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1715 microversion: 2.1 time: 0.146583 May 13 12:57:27.795229 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 178/331] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:27 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1715 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:28.614210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:28.614756 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:28.621801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:28.622343 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:28.623227 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:28.623794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:28.748339 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:28.756475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:28.758703 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:28.759859 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1fd44485-81e0-4a36-ad01-29d2cacebd52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.149672 May 13 12:57:28.760421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 154/332] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:28 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:29.778855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:29.779730 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:29.785629 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:29.786075 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:29.786832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:29.787262 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:29.919713 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:29.928310 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:29.930410 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:29.931568 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e7da1635-94b0-4e10-a609-7ffe881e219f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.156649 May 13 12:57:29.932136 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 179/333] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:29 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:30.949348 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:30.949963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:30.956224 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:30.956672 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:30.957463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:30.957899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:31.088761 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:31.097001 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:31.098513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:31.099717 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f5ca8f45-562e-4c3e-91c5-ab2bb4e3c5b3 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.154594 May 13 12:57:31.100281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 155/334] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:30 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:32.117996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:32.118800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:32.124848 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:32.125327 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:32.126094 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:32.126531 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:32.251470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:32.260342 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:32.261881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:32.263042 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3ee5cf3d-dfe0-42eb-8aeb-019a859c6e83 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.149173 May 13 12:57:32.263615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 180/335] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:32 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:33.281354 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:33.281868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:33.288613 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:33.289719 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:33.290621 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:33.291185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:33.419195 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:33.427688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:33.429218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:33.430819 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-67770c8f-0d23-4ff3-80ba-f63d689717f8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.153563 May 13 12:57:33.431379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 156/336] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:33 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:33.887778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-9f9a9c46-038c-4622-8875-f8ae47a80bdb req-7b6f319d-449b-4014-8f27-32c3ab59cdd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83873f65-ba42-4536-9af6-4aff1db77bb4", "name": "network-vif-plugged", "status": "completed", "tag": "312207b7-e73e-4ced-8336-af184bb733a6"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:33.895748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9f9a9c46-038c-4622-8875-f8ae47a80bdb req-7b6f319d-449b-4014-8f27-32c3ab59cdd0 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:33.896249 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9f9a9c46-038c-4622-8875-f8ae47a80bdb req-7b6f319d-449b-4014-8f27-32c3ab59cdd0 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:33.908176 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-9f9a9c46-038c-4622-8875-f8ae47a80bdb req-7b6f319d-449b-4014-8f27-32c3ab59cdd0 service nova] Creating event network-vif-plugged:312207b7-e73e-4ced-8336-af184bb733a6 for instance 83873f65-ba42-4536-9af6-4aff1db77bb4 on hv-cinder-84164 May 13 12:57:33.913250 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-9f9a9c46-038c-4622-8875-f8ae47a80bdb req-7b6f319d-449b-4014-8f27-32c3ab59cdd0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030029 May 13 12:57:33.913908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 181/337] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:34.449527 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:34.450148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:34.456449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:34.456904 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:34.457712 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:34.458157 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:34.596140 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:34.605062 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:34.606576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:34.607743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8ca90b89-c8f8-48bf-ae7d-0276357e9555 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.162888 May 13 12:57:34.608309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 157/338] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:34 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:35.626878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:35.627580 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:35.633914 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:35.634379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:35.635132 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:35.635701 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:35.762528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:35.770610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:35.772095 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:35.773490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d32b5478-5123-4eb3-8ce6-af9b781b5aa6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.150723 May 13 12:57:35.774591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 182/339] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:35 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:36.793057 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:36.793673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:36.800004 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:36.800453 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:36.801239 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:36.801681 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:36.939031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:36.947870 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:36.949433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:36.950664 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-25a2def2-a73d-4f6f-b049-844b9187ab73 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1808 microversion: 2.20 time: 0.162432 May 13 12:57:36.951222 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 158/340] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:36 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:37.969574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:37.970192 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:37.976449 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:37.977516 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:37.978463 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:37.978908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:38.104166 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:38.112317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:38.113843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:38.114983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0e68ccec-f5ea-4dbe-9d12-0bf0af6ab630 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1795 microversion: 2.20 time: 0.149373 May 13 12:57:38.115550 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 183/341] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:57:37 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1795 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:57:46.022749 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3644d43a-7f05-4e23-9a61-f0b347356eda tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:46.023238 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3644d43a-7f05-4e23-9a61-f0b347356eda tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:46.029694 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3644d43a-7f05-4e23-9a61-f0b347356eda tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.030409 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3644d43a-7f05-4e23-9a61-f0b347356eda tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.031178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3644d43a-7f05-4e23-9a61-f0b347356eda tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.031614 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3644d43a-7f05-4e23-9a61-f0b347356eda tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.054482 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3644d43a-7f05-4e23-9a61-f0b347356eda tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1/ips" status: 200 len: 148 microversion: 2.1 time: 0.035893 May 13 12:57:46.055235 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 159/342] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 12:57:46 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:46.065602 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69430ce-2e04-4bb9-bee6-82046a74d9c1"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:46.066672 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:46.073236 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.073692 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.074467 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.074910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.159816 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Invalid volume: volume e69430ce-2e04-4bb9-bee6-82046a74d9c1 is already attached to instances: 34789621-2e0a-4fef-8268-7703885edac6 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: POST /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1/os-volume_attachments HTTP/1.1 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 74 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 12:57:46.161579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {"volumeAttachment": {"volumeId": "e69430ce-2e04-4bb9-bee6-82046a74d9c1"}} May 13 12:57:46.163147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Invalid volume: volume e69430ce-2e04-4bb9-bee6-82046a74d9c1 is already attached to instances: 34789621-2e0a-4fef-8268-7703885edac6 May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'server_id': '42b7e01b-70b1-46a0-96f0-1c412e18c5e1', 'body': {'volumeAttachment': {'volumeId': 'e69430ce-2e04-4bb9-bee6-82046a74d9c1'}}} May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e69430ce-2e04-4bb9-bee6-82046a74d9c1 is already attached to instances: 34789621-2e0a-4fef-8268-7703885edac6 May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:46.164153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e69430ce-2e04-4bb9-bee6-82046a74d9c1 is already attached to instances: 34789621-2e0a-4fef-8268-7703885edac6 May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:57:46.165879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e69430ce-2e04-4bb9-bee6-82046a74d9c1 is already attached to instances: 34789621-2e0a-4fef-8268-7703885edac6 May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 400 to user: Invalid volume: volume e69430ce-2e04-4bb9-bee6-82046a74d9c1 is already attached to instances: 34789621-2e0a-4fef-8268-7703885edac6 {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b28855a0-bde7-4a71-b947-196b0764d60c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101417 May 13 12:57:46.167197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 184/343] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:57:46 2022] POST /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 12:57:46.171879 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:46.172371 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:46.179250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.179697 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.180459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.180890 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.204665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:57:46.289028 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4d04106a-e081-4980-b8b8-d19ecc51f163 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 204 len: 0 microversion: 2.1 time: 0.120010 May 13 12:57:46.289743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 160/344] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:57:46 2022] DELETE /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 12:57:46.297842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:46.298460 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:46.305265 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.305712 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.306473 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:46.306907 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:46.439148 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:46.447121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5e973b8a-7036-4c5a-b06c-8487da8415f9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1679 microversion: 2.1 time: 0.153076 May 13 12:57:46.447681 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 185/345] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:46 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:47.466435 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:47.467256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:47.473743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:47.474196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:47.474980 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:47.475632 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:47.604734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:47.612000 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d23bb7e6-8a7a-41b3-a26a-8b57cd7cd0c8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1679 microversion: 2.1 time: 0.149777 May 13 12:57:47.612573 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 161/346] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:47 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:48.629780 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:48.630409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:48.637524 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:48.637988 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:48.638766 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:48.639206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:48.729841 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:48.738337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9142d5b3-981b-4565-85b8-7f5f07dac049 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1611 microversion: 2.1 time: 0.112283 May 13 12:57:48.739464 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 186/347] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:48 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1611 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:49.041215 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-c877c6af-8efb-4acb-bb25-2709bcdc46a6 req-f6c91bae-3f8d-42fc-94f0-a5e0e9e491c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b7e01b-70b1-46a0-96f0-1c412e18c5e1", "name": "network-vif-deleted", "tag": "6131eae9-947c-4782-958f-bf729b85fce7"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:49.052953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c877c6af-8efb-4acb-bb25-2709bcdc46a6 req-f6c91bae-3f8d-42fc-94f0-a5e0e9e491c2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:49.053432 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c877c6af-8efb-4acb-bb25-2709bcdc46a6 req-f6c91bae-3f8d-42fc-94f0-a5e0e9e491c2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:49.065793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-c877c6af-8efb-4acb-bb25-2709bcdc46a6 req-f6c91bae-3f8d-42fc-94f0-a5e0e9e491c2 service nova] Creating event network-vif-deleted:6131eae9-947c-4782-958f-bf729b85fce7 for instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 on hv-cinder-84164 May 13 12:57:49.072528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-c877c6af-8efb-4acb-bb25-2709bcdc46a6 req-f6c91bae-3f8d-42fc-94f0-a5e0e9e491c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035702 May 13 12:57:49.074080 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 162/348] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:49.335016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8eca0979-3526-4600-af76-dcfc9eeafc54 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad1332f0-5aef-4dff-8601-6a265a1a44fa"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:49.336833 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8eca0979-3526-4600-af76-dcfc9eeafc54 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:49.343492 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8eca0979-3526-4600-af76-dcfc9eeafc54 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:49.344832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8eca0979-3526-4600-af76-dcfc9eeafc54 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:49.345876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8eca0979-3526-4600-af76-dcfc9eeafc54 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:49.346512 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8eca0979-3526-4600-af76-dcfc9eeafc54 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:49.705845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8eca0979-3526-4600-af76-dcfc9eeafc54 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375631 May 13 12:57:49.710466 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 187/349] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:57:49 2022] POST /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:49.756330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:49.757156 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:49.766079 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:49.767009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:49.769229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:49.770977 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:49.806337 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:49.806731 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:49.807181 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lazy-loading 'fault' on Instance uuid 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:57:49.856413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:49.865413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-47817dcd-40eb-4174-ac3c-022a687c0701 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 200 len: 1330 microversion: 2.1 time: 0.113294 May 13 12:57:49.866003 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 163/350] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:49 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:50.885204 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:50.885816 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:50.892324 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:50.892778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:50.893566 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:50.894006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:50.908077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 HTTP/1.1 May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 12:57:50.910420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 12:57:50.911956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '42b7e01b-70b1-46a0-96f0-1c412e18c5e1'} May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:57:50.912810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 12:57:50.914475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:57:50.915984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:57:50.915984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-19f4d7af-36ae-412c-9ac6-3622ff7e811f tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 404 len: 111 microversion: 2.1 time: 0.031928 May 13 12:57:50.915984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 188/351] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:50 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:57:50.921197 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-04daae66-d45a-4454-bf99-ec7913dee194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '.version_select at 0x7f060211ab80>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:50.949139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-04daae66-d45a-4454-bf99-ec7913dee194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-634374857" status: 202 len: 0 microversion: 2.1 time: 0.031719 May 13 12:57:50.950183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 164/352] 10.222.0.49 () {58 vars in 1217 bytes} [Fri May 13 12:57:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-634374857 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:57:51.640005 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:51.640500 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:51.646724 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:51.647170 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:51.648073 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:51.648540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:51.767044 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lazy-loading 'services' on Instance uuid 34789621-2e0a-4fef-8268-7703885edac6 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:57:51.888478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-254258c4-01a7-4e10-b91c-74f78f6a2fd4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments/e69430ce-2e04-4bb9-bee6-82046a74d9c1" status: 202 len: 0 microversion: 2.1 time: 0.252150 May 13 12:57:51.889239 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 189/353] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 12:57:51 2022] DELETE /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments/e69430ce-2e04-4bb9-bee6-82046a74d9c1 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:57:51.897321 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f0a6da23-ed28-4632-b19e-4308cb8657ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:51.898250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f0a6da23-ed28-4632-b19e-4308cb8657ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:51.905273 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0a6da23-ed28-4632-b19e-4308cb8657ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:51.905739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0a6da23-ed28-4632-b19e-4308cb8657ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:51.906526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0a6da23-ed28-4632-b19e-4308cb8657ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:51.906956 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0a6da23-ed28-4632-b19e-4308cb8657ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:51.937957 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f0a6da23-ed28-4632-b19e-4308cb8657ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 May 13 12:57:51.938616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 165/354] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:57:51 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:52.950763 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d9016baa-841c-47a6-bb95-76c62f2e356a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:52.951823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d9016baa-841c-47a6-bb95-76c62f2e356a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:52.958552 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9016baa-841c-47a6-bb95-76c62f2e356a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:52.958999 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9016baa-841c-47a6-bb95-76c62f2e356a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:52.959768 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9016baa-841c-47a6-bb95-76c62f2e356a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:52.960206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9016baa-841c-47a6-bb95-76c62f2e356a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:52.990078 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d9016baa-841c-47a6-bb95-76c62f2e356a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 May 13 12:57:52.990644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 190/355] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:57:52 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:54.001126 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-90d73eea-c7ca-4f07-b30c-8cd818e1eb7d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:54.002047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-90d73eea-c7ca-4f07-b30c-8cd818e1eb7d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:54.008257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-90d73eea-c7ca-4f07-b30c-8cd818e1eb7d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:54.008722 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-90d73eea-c7ca-4f07-b30c-8cd818e1eb7d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:54.009580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-90d73eea-c7ca-4f07-b30c-8cd818e1eb7d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:54.010015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-90d73eea-c7ca-4f07-b30c-8cd818e1eb7d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:54.039008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-90d73eea-c7ca-4f07-b30c-8cd818e1eb7d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041805 May 13 12:57:54.040239 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 166/356] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:57:53 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:55.050722 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e3674d48-bae2-4d3d-a72f-430ff5b49171 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:55.051645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e3674d48-bae2-4d3d-a72f-430ff5b49171 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:55.058819 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3674d48-bae2-4d3d-a72f-430ff5b49171 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:55.059271 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3674d48-bae2-4d3d-a72f-430ff5b49171 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:55.060071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3674d48-bae2-4d3d-a72f-430ff5b49171 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:55.060536 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e3674d48-bae2-4d3d-a72f-430ff5b49171 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:55.088457 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e3674d48-bae2-4d3d-a72f-430ff5b49171 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 May 13 12:57:55.089024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 191/357] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:57:55 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:56.099624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-77156ba7-aaaf-48cd-b548-16791c5d9194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:56.100551 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-77156ba7-aaaf-48cd-b548-16791c5d9194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:56.107407 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77156ba7-aaaf-48cd-b548-16791c5d9194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:56.107859 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77156ba7-aaaf-48cd-b548-16791c5d9194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:56.108626 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77156ba7-aaaf-48cd-b548-16791c5d9194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:56.109089 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77156ba7-aaaf-48cd-b548-16791c5d9194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:56.137276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-77156ba7-aaaf-48cd-b548-16791c5d9194 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 May 13 12:57:56.137826 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 167/358] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:57:56 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:57.147908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-80332ce9-1e2f-4a9b-90ad-f96c24a0ead4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:57.148834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-80332ce9-1e2f-4a9b-90ad-f96c24a0ead4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:57.155656 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-80332ce9-1e2f-4a9b-90ad-f96c24a0ead4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:57.156108 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-80332ce9-1e2f-4a9b-90ad-f96c24a0ead4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:57.156888 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-80332ce9-1e2f-4a9b-90ad-f96c24a0ead4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:57.158472 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-80332ce9-1e2f-4a9b-90ad-f96c24a0ead4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:57.196924 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-80332ce9-1e2f-4a9b-90ad-f96c24a0ead4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046130 May 13 12:57:57.196924 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 192/359] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:57:57 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:57:57.205334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:57:57.206341 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:57.212634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:57.213122 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:57.213893 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:57.214331 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:57.236934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lazy-loading 'flavor' on Instance uuid 01d6f955-cec3-41be-b4c3-c1ab08771e24 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:57:57.356913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-26619cce-a91e-423e-82f7-3d0f2c3831fd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/action" status: 200 len: 32 microversion: 2.1 time: 0.155479 May 13 12:57:57.357513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 168/360] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:57:57 2022] POST /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 12:57:57.366303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:57.366917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:57.373546 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:57.374253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:57.375015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:57.375615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:57.579471 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:57.587481 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0189aaf0-1f9b-4beb-a002-57d6c5a92a99 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.224933 May 13 12:57:57.588079 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 193/361] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:57 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:58.202744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-142aa5ab-f93c-405b-849d-4859635188c3 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:58.203820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-142aa5ab-f93c-405b-849d-4859635188c3 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:58.210546 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-142aa5ab-f93c-405b-849d-4859635188c3 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.211138 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-142aa5ab-f93c-405b-849d-4859635188c3 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.213017 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-142aa5ab-f93c-405b-849d-4859635188c3 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.213488 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-142aa5ab-f93c-405b-849d-4859635188c3 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.241651 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-142aa5ab-f93c-405b-849d-4859635188c3 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043177 May 13 12:57:58.242204 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 169/362] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:57:58 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 12:57:58.300446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:58.300956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:58.307676 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.308495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.309308 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.309756 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.335726 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:57:58.410331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5f10ecbe-a261-45ac-a33b-2e84a0af2d87 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 204 len: 0 microversion: 2.1 time: 0.113409 May 13 12:57:58.410931 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 194/363] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:57:58 2022] DELETE /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 12:57:58.419794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:58.420405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:58.426190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.426644 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.427414 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.427857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.558071 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:58.565257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-390d82ae-5b60-4202-9514-789441ecdc66 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1681 microversion: 2.1 time: 0.149746 May 13 12:57:58.565820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 170/364] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:58 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:58.604343 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:58.605083 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:58.610971 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.611425 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.612195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:58.612636 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:58.740463 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:58.748686 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b33aa5e3-6ff8-45e7-9406-8a8134a36f8c tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.148900 May 13 12:57:58.749294 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 195/365] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:58 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:59.582124 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:59.582739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:59.590064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:59.590512 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:59.591278 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:59.591716 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:59.717380 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:59.724765 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b27d8f7a-a977-4768-9a9b-2e236adcb6fe tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1681 microversion: 2.1 time: 0.146509 May 13 12:57:59.725379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 171/366] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:59 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:57:59.766363 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:57:59.766974 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:57:59.773208 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:59.773638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:59.774993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:57:59.775428 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:57:59.903093 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:57:59.911047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3584de98-cdae-4388-b4f2-07387883a7c9 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.148483 May 13 12:57:59.911613 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 196/367] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:57:59 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:00.741960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:00.742694 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:00.749366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:00.749819 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:00.750591 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:00.751026 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:00.879678 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:00.887062 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9b5dbd37-df2b-4989-b5a0-f0006af1f15a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1681 microversion: 2.1 time: 0.148949 May 13 12:58:00.887636 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 172/368] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:00 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:00.929735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:00.931277 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:00.945471 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:00.947180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:00.947989 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:00.948563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:01.374895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:01.383882 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-76a0d615-1927-4886-97c8-4476232dd87e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.458188 May 13 12:58:01.384476 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 197/369] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:00 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:01.528362 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-85a5b6be-1c6c-42ea-9b9f-025f7c0eb014 req-c57c133c-6a35-4a87-9b66-880873d19a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34789621-2e0a-4fef-8268-7703885edac6", "name": "network-vif-deleted", "tag": "99a73876-f6c7-452e-b541-5ee509349a0a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:01.538284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-85a5b6be-1c6c-42ea-9b9f-025f7c0eb014 req-c57c133c-6a35-4a87-9b66-880873d19a6c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:01.538658 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-85a5b6be-1c6c-42ea-9b9f-025f7c0eb014 req-c57c133c-6a35-4a87-9b66-880873d19a6c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:01.552363 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-85a5b6be-1c6c-42ea-9b9f-025f7c0eb014 req-c57c133c-6a35-4a87-9b66-880873d19a6c service nova] Creating event network-vif-deleted:99a73876-f6c7-452e-b541-5ee509349a0a for instance 34789621-2e0a-4fef-8268-7703885edac6 on hv-cinder-84164 May 13 12:58:01.557715 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-85a5b6be-1c6c-42ea-9b9f-025f7c0eb014 req-c57c133c-6a35-4a87-9b66-880873d19a6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033391 May 13 12:58:01.558334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 173/370] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:01.904234 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:01.904868 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:01.910871 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:01.911327 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:01.912086 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:01.912516 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:01.944538 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:01.945273 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:01.945985 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lazy-loading 'fault' on Instance uuid 34789621-2e0a-4fef-8268-7703885edac6 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:58:02.003023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:02.011474 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-47322681-2605-4d95-94b8-1f41b2d895c7 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 200 len: 1332 microversion: 2.1 time: 0.111033 May 13 12:58:02.012053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 198/371] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:01 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:02.402577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:02.403416 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:02.410150 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:02.410581 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:02.411360 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:02.411798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:02.547068 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:02.555926 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6b2d172f-b72a-4c63-ad34-83aeae03abe6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.157609 May 13 12:58:02.556841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 174/372] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:02 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:03.028648 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:03.029311 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:03.036114 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:03.036568 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:03.037369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:03.037809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:03.051537 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 HTTP/1.1 May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 12:58:03.053232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 12:58:03.054930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '34789621-2e0a-4fef-8268-7703885edac6'} May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:58:03.056416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 12:58:03.057918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:58:03.059215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:58:03.059215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a73e9650-f280-4c9e-9e2b-213776863910 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 404 len: 111 microversion: 2.1 time: 0.029863 May 13 12:58:03.059215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 199/373] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:03 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:58:03.064377 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-784630ca-b5db-4f59-8aff-c68a5124c3dc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '.version_select at 0x7f060213aaf0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:03.081381 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-784630ca-b5db-4f59-8aff-c68a5124c3dc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712393787" status: 202 len: 0 microversion: 2.1 time: 0.020737 May 13 12:58:03.081940 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 175/374] 10.222.0.49 () {58 vars in 1220 bytes} [Fri May 13 12:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712393787 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:58:03.574353 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:03.574935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:03.583462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:03.583968 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:03.586156 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:03.587170 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:03.747273 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-db5c444e-91c7-4bee-82b2-cb4488912b61 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: .version_select at 0x7f06020ec820>, body: {"keypair": {"name": "tempest-keypair-1650815642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFA346BuDa8WkSpgJUPcqFz+aGa8UerJlxZA7tQpWx7vUUl3CSyJBHPz7jLqG27wCDPODHfdnX0k6hT3hIOmIVFKEEjtUb9YPzKRuxADCNzxdYdG69Se2vmKM5eSPmd5nw=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:03.761954 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-db5c444e-91c7-4bee-82b2-cb4488912b61 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:58:03.762721 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:03.765907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-db5c444e-91c7-4bee-82b2-cb4488912b61 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:58:03.770466 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-90961c57-8bc6-442f-81ed-f4599a4bfa65 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.201063 May 13 12:58:03.771032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 200/375] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:03 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:03.787379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-db5c444e-91c7-4bee-82b2-cb4488912b61 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045012 May 13 12:58:03.787974 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 176/376] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 12:58:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:58:04.787095 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:04.787720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:04.794969 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:04.795423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:04.796208 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:04.796646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:04.930946 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:04.942177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-78051264-fe01-4931-8925-66801e080fbc tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.158621 May 13 12:58:04.943045 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 201/377] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:04 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:05.055060 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-757945685", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1c41e28-5d16-459f-865e-9320359228db"}], "security_groups": [{"name": "tempest-securitygroup--533773853"}], "key_name": "tempest-keypair-1650815642", "user_data": "}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:05.155693 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] validate_networks() for [('f1c41e28-5d16-459f-865e-9320359228db', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:58:05.507337 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:58:05.507766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:58:05.508305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:58:05.509479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:58:05.509848 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:58:05.518330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:05.518779 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:05.519580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:05.520015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:05.537004 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:58:05.541503 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:58:05.551994 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:58:05.554256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:58:05.599987 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-74954ffd-476d-45a9-afa8-e25e408b6f46 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.549761 May 13 12:58:05.600665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 177/378] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:58:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 12:58:05.611484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d7d8b90f-20b1-45f1-8cba-564d9dd5d198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:05.612103 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d7d8b90f-20b1-45f1-8cba-564d9dd5d198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:05.665976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d7d8b90f-20b1-45f1-8cba-564d9dd5d198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:05.672381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d7d8b90f-20b1-45f1-8cba-564d9dd5d198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1241 microversion: 2.1 time: 0.064838 May 13 12:58:05.672954 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 202/379] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:05 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:05.965572 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:05.966200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:05.972768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:05.973431 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:05.974048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:05.974536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:06.112337 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:06.120736 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-bf944e61-cf71-4962-8607-8a02f96c6d6a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.159597 May 13 12:58:06.121339 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 178/380] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:05 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:06.690461 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:06.691907 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:06.698196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:06.699062 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:06.699910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:06.700598 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:06.769131 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:06.777513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d281d65c-1697-4088-9e5e-1643c9ce2612 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1299 microversion: 2.1 time: 0.091340 May 13 12:58:06.778090 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 203/381] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:06 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:06.788210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:06.788718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:06.795499 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:06.795953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:06.796731 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:06.797201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:06.918306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lazy-loading 'services' on Instance uuid a805ac8a-8fbf-4bf1-b369-64eaef204809 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:58:07.033931 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6fc44e4d-3963-4f5f-9aba-cfdc7f7dc426 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-volume_attachments/3d2d0296-55dc-441d-93ca-c70b4e7eafdd" status: 202 len: 0 microversion: 2.1 time: 0.249497 May 13 12:58:07.034611 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 179/382] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 12:58:06 2022] DELETE /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-volume_attachments/3d2d0296-55dc-441d-93ca-c70b4e7eafdd => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:58:07.138168 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:07.138858 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:07.145254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:07.145702 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:07.146657 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:07.147095 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:07.353120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:07.361030 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-86c4258d-031a-480e-b83f-8b360c1ce0b3 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.227190 May 13 12:58:07.361838 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 204/383] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:07 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:07.796684 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:07.797609 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:07.803847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:07.804377 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:07.805303 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:07.805856 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:07.939139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:07.947154 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2abe3361-81ff-4070-b8b4-7b23b73a98ed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.154966 May 13 12:58:07.947730 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 180/384] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:07 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:08.163148 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8504b5a6-b0db-423b-ae41-ac110fc83f6c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:08.171406 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8504b5a6-b0db-423b-ae41-ac110fc83f6c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.171702 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8504b5a6-b0db-423b-ae41-ac110fc83f6c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:08.194372 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8504b5a6-b0db-423b-ae41-ac110fc83f6c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Going to try to stop instance {{(pid=123410) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 12:58:08.230560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-c2b1e797-a6d3-4e72-9e78-75ed8d5f9ec5 req-4a860895-455b-48ee-ad23-ff90585b643a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70fd3419-f741-4630-b0a8-288fd40f27d0", "tag": "b7816347-fb88-41c1-b266-5d5b1c98bb4b"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:08.256446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8504b5a6-b0db-423b-ae41-ac110fc83f6c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action" status: 202 len: 0 microversion: 2.1 time: 0.102244 May 13 12:58:08.260898 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 205/385] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:58:08 2022] POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:58:08.267663 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:08.267973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c2b1e797-a6d3-4e72-9e78-75ed8d5f9ec5 req-4a860895-455b-48ee-ad23-ff90585b643a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.268756 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:08.277176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c2b1e797-a6d3-4e72-9e78-75ed8d5f9ec5 req-4a860895-455b-48ee-ad23-ff90585b643a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:08.289975 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.291047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:08.292092 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.293125 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:08.306800 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-c2b1e797-a6d3-4e72-9e78-75ed8d5f9ec5 req-4a860895-455b-48ee-ad23-ff90585b643a service nova] Creating event network-changed:b7816347-fb88-41c1-b266-5d5b1c98bb4b for instance 70fd3419-f741-4630-b0a8-288fd40f27d0 on hv-cinder-84164 May 13 12:58:08.311922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-c2b1e797-a6d3-4e72-9e78-75ed8d5f9ec5 req-4a860895-455b-48ee-ad23-ff90585b643a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085837 May 13 12:58:08.312825 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 181/386] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:08.379351 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:08.380295 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:08.387455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.387908 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:08.388732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.389202 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:08.462453 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:08.471356 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-dc177db4-c5be-4029-a96d-68e132786606 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.208754 May 13 12:58:08.471945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 206/387] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:08 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:08.540566 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:08.548280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-88bb32db-40b6-443d-bfd7-698a9165d14a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.173271 May 13 12:58:08.548853 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 182/388] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:08 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:58:08.964214 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:08.964834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:08.970883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.971336 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:08.972113 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:08.972549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:09.098429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:09.106464 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9c6b5b86-8ba1-406a-b36d-cb3daa9d66fb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.146648 May 13 12:58:09.107046 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 207/389] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:08 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:09.489009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:09.489635 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:09.495710 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:09.496163 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:09.496928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:09.497395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:09.566232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:09.566856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:09.573958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:09.574409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:09.575218 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:09.575671 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:09.625293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:09.632615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6d4c12dd-7011-42f0-814b-19940c9d1b7b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.147522 May 13 12:58:09.633729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 183/390] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:09 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:09.703196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:09.710866 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-231c68cf-6bf0-4bbb-af33-a72f99a791ec tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.148708 May 13 12:58:09.711475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 208/391] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:09 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:10.124214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:10.124799 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:10.130793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:10.131248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:10.132014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:10.132451 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:10.260568 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:10.267872 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d9c68313-392a-4690-8fa4-6e8c2cb1df5d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.147612 May 13 12:58:10.268453 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 184/392] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:10 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:10.650415 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:10.651499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:10.658725 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:10.659175 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:10.659952 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:10.660396 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:10.727810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:10.728465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:10.734806 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:10.735264 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:10.736053 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:10.736484 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:10.795995 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:10.803490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-18dd40d7-1bc8-4812-9a15-101df0f4ccb5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.157676 May 13 12:58:10.804072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 209/393] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:10 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:10.864861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:10.873432 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b35b32e1-cbc9-4739-ba1f-56bda95c649e tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.149779 May 13 12:58:10.874001 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 185/394] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:10 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:58:11.289171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:11.290380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:11.296767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:11.297248 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:11.298020 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:11.298452 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:11.422231 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:11.429423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f6d239ad-1ad0-4296-be4d-3a2e0b1dad48 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.144113 May 13 12:58:11.430006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 210/395] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:11 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:11.822368 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:11.822920 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:11.829250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:11.829700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:11.830504 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:11.830925 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:11.890221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:11.890833 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:11.897084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:11.897532 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:11.898304 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:11.898817 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:12.046623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:12.056190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0493c4d6-b65c-4e8a-a543-613e51b8d2e5 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1735 microversion: 2.1 time: 0.168946 May 13 12:58:12.056900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 211/396] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:11 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:58:12.237363 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:12.245674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d79a55d8-1653-4561-9f9d-2f823acff33c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.427835 May 13 12:58:12.246264 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 186/397] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:11 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:12.447346 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:12.448350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:12.454229 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:12.454675 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:12.455432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:12.455864 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:12.587224 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:12.596427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5eb0ebcd-6d02-4378-a423-03d16e04d118 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.152922 May 13 12:58:12.597054 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 212/398] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:12 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:13.073823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:13.074471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:13.080803 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.081292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.082064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.082509 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.210410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:13.218888 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-767b4b24-741a-4509-886c-61fbbcfec118 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1715 microversion: 2.1 time: 0.149474 May 13 12:58:13.219463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 187/399] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:13 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:13.263366 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:13.264077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:13.270722 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.271171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.271961 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.272392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.322296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:13.322794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:13.328556 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.329036 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.329814 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.330255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.403814 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:13.411404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c9a75757-df2e-4667-9194-57fdb3cb1c73 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.152276 May 13 12:58:13.411824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] HTTP exception thrown: Cannot 'detach_volume' instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 while it is in vm_state rescued May 13 12:58:13.416025 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 213/400] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:13 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Request method failure captured: May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments/ad1332f0-5aef-4dff-8601-6a265a1a44fa HTTP/1.1 May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUX6d6ZDKe_nV9YYJJ-Xgg5nq_eQ3qvvcgCeINIKbafVPAIxtWuud204p2x-5jTuIcu4tEnOLvL-XOxslje6BHnGbrbs9z9B_oA_4fgBX5U-tG-0VDQcSFULd0UkNyRJUKeO4CldWqBU_j9rU8l9IFocTMVLdpP7wQR4AMFIFaIgc8 May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:58:13.416162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_58bddca6077344bea4cb41b23fcf8d35", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: fbad87a0396f4deb92f4da676af8bfdb May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:58:13.417557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Cannot 'detach_volume' instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 while it is in vm_state rescued May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'server_id': '01d6f955-cec3-41be-b4c3-c1ab08771e24', 'id': 'ad1332f0-5aef-4dff-8601-6a265a1a44fa'} May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:58:13.418218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 while it is in vm_state rescued May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 while it is in vm_state rescued May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:13.419366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Returning 409 to user: Cannot 'detach_volume' instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 while it is in vm_state rescued {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:58:13.420616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-65be33d9-2ab2-485f-9040-2accfb86790f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments/ad1332f0-5aef-4dff-8601-6a265a1a44fa" status: 409 len: 152 microversion: 2.1 time: 0.097445 May 13 12:58:13.420616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 188/401] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 12:58:13 2022] DELETE /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments/ad1332f0-5aef-4dff-8601-6a265a1a44fa => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 13 12:58:13.425761 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-bd1314d7-887d-41c4-b464-dd58148ba1b2 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:13.426320 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-bd1314d7-887d-41c4-b464-dd58148ba1b2 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:13.432778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd1314d7-887d-41c4-b464-dd58148ba1b2 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.433257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd1314d7-887d-41c4-b464-dd58148ba1b2 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.434018 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd1314d7-887d-41c4-b464-dd58148ba1b2 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.434456 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd1314d7-887d-41c4-b464-dd58148ba1b2 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.497763 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-bd1314d7-887d-41c4-b464-dd58148ba1b2 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "POST /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/action" status: 202 len: 0 microversion: 2.1 time: 0.075391 May 13 12:58:13.498331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 214/402] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:58:13 2022] POST /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:58:13.506437 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:13.507062 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:13.515231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.515748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.516578 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.517056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.614526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:13.615350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:13.622380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.622839 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.623618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:13.624195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:13.725089 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:13.733343 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9ccbd763-b0b9-4e65-9a82-d9165684e682 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1723 microversion: 2.1 time: 0.230698 May 13 12:58:13.733916 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 189/403] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:13 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:13.760231 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:13.767634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7ba32b38-3149-4392-9709-50d59ff046c9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.157387 May 13 12:58:13.768217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 215/404] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:13 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:14.119179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-9512310f-6bcd-444a-b2ae-d702392d0046 req-c1518ebd-e359-4b72-9a2c-46203af7def8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70fd3419-f741-4630-b0a8-288fd40f27d0", "name": "network-vif-plugged", "status": "completed", "tag": "b7816347-fb88-41c1-b266-5d5b1c98bb4b"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:14.132792 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-9512310f-6bcd-444a-b2ae-d702392d0046 req-c1518ebd-e359-4b72-9a2c-46203af7def8 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:14.133314 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-9512310f-6bcd-444a-b2ae-d702392d0046 req-c1518ebd-e359-4b72-9a2c-46203af7def8 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:14.145385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-9512310f-6bcd-444a-b2ae-d702392d0046 req-c1518ebd-e359-4b72-9a2c-46203af7def8 service nova] Creating event network-vif-plugged:b7816347-fb88-41c1-b266-5d5b1c98bb4b for instance 70fd3419-f741-4630-b0a8-288fd40f27d0 on hv-cinder-84164 May 13 12:58:14.152335 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-9512310f-6bcd-444a-b2ae-d702392d0046 req-c1518ebd-e359-4b72-9a2c-46203af7def8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041234 May 13 12:58:14.153074 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 190/405] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:14.427948 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:14.428634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:14.436646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:14.437365 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:14.438215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:14.438596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:14.575759 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:14.583639 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-90f61eec-e7c6-405f-892e-999c3b82d2db tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.159499 May 13 12:58:14.584151 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 216/406] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:14 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:14.751902 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:14.752602 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:14.759855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:14.760302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:14.761099 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:14.761660 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:14.785249 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:14.786255 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:14.792411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:14.792869 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:14.793673 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:14.794108 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:14.913511 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:14.922743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c7f5628b-64c6-48c9-8490-e8e960498e34 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1723 microversion: 2.1 time: 0.174837 May 13 12:58:14.923377 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 191/407] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:14 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:14.931953 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:14.940265 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d226cfef-de09-4a4b-80af-e3749bfa25d5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.160710 May 13 12:58:14.940945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 217/408] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:14 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:58:15.601869 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:15.602785 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:15.609120 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:15.609572 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:15.610334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:15.610775 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:15.769837 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:15.777335 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3f735984-8a49-4e26-b66a-88cfa904206a tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.179415 May 13 12:58:15.777900 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 192/409] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:15 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:15.939735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:15.940351 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:15.947916 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:15.948363 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:15.949170 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:15.949607 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:15.960134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:15.960751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:15.968462 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:15.968918 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:15.969729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:15.970166 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:16.081968 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:16.090617 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c0c85907-e511-48c9-a2df-f39a2e5b2c41 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1723 microversion: 2.1 time: 0.154616 May 13 12:58:16.091207 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 218/410] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:15 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:16.105668 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:16.112926 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-156eb0cf-d838-49e3-a6b1-a264d56ca3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.156585 May 13 12:58:16.113514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 193/411] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:15 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:58:16.794932 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:16.795547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:16.801740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:16.802189 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:16.802986 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:16.803420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:16.934636 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:16.941945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1877f6c9-c395-4003-8ba7-e7421b33dcab tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.150908 May 13 12:58:16.942503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 219/412] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:16 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:17.107738 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:17.108352 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:17.114739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.115189 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:17.115956 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.116396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:17.130215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:17.131499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:17.138737 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.139186 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:17.139957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.140394 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:17.245690 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:17.254105 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-99f0d30c-b368-4fbe-9396-7b2e1f95d4b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1729 microversion: 2.1 time: 0.150261 May 13 12:58:17.254886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 194/413] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:17 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:17.272902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:17.273364 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-36654b1e-b03e-48ce-9057-55242e392bd6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:17.274397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-36654b1e-b03e-48ce-9057-55242e392bd6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:17.280265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36654b1e-b03e-48ce-9057-55242e392bd6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.280953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36654b1e-b03e-48ce-9057-55242e392bd6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:17.281510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-828f8fff-48ce-48ac-90de-74e33d033bd0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1366 microversion: 2.1 time: 0.155099 May 13 12:58:17.281750 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36654b1e-b03e-48ce-9057-55242e392bd6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.282314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 220/414] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:17 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:58:17.282437 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36654b1e-b03e-48ce-9057-55242e392bd6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:17.360083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-36654b1e-b03e-48ce-9057-55242e392bd6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092329 May 13 12:58:17.360717 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 195/415] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:58:17 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:58:17.958823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:17.959436 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:17.966026 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.966481 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:17.967271 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:17.967710 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:18.101462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:18.109601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9a32d244-87e0-4ba0-a428-513c06d2f319 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1679 microversion: 2.1 time: 0.154601 May 13 12:58:18.110183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 221/416] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:17 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:18.287080 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-4766b09c-e4df-4160-a403-a1701b1d1cba req-6cb52778-d837-418b-8c4a-68e03b64b0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d6f955-cec3-41be-b4c3-c1ab08771e24", "tag": "c221412b-60f8-4ab0-b29a-df7ab68bd041"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:18.300119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-4766b09c-e4df-4160-a403-a1701b1d1cba req-6cb52778-d837-418b-8c4a-68e03b64b0b0 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:18.301033 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-4766b09c-e4df-4160-a403-a1701b1d1cba req-6cb52778-d837-418b-8c4a-68e03b64b0b0 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:18.301167 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:18.301746 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:18.308627 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:18.309280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:18.310070 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:18.310508 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:18.315885 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-4766b09c-e4df-4160-a403-a1701b1d1cba req-6cb52778-d837-418b-8c4a-68e03b64b0b0 service nova] Creating event network-changed:c221412b-60f8-4ab0-b29a-df7ab68bd041 for instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 on hv-cinder-84164 May 13 12:58:18.321267 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-4766b09c-e4df-4160-a403-a1701b1d1cba req-6cb52778-d837-418b-8c4a-68e03b64b0b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038051 May 13 12:58:18.322454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 196/417] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:18.446862 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:18.454408 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-115fe01e-3ca1-4c4d-baed-5f33ebccf38e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1555 microversion: 2.1 time: 0.159211 May 13 12:58:18.465606 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 222/418] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:18 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:18.472361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-822a4bc9-8ca6-4355-b3f8-4141e93f59c6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:18.472946 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-822a4bc9-8ca6-4355-b3f8-4141e93f59c6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:18.480251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-822a4bc9-8ca6-4355-b3f8-4141e93f59c6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:18.480710 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-822a4bc9-8ca6-4355-b3f8-4141e93f59c6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:18.481514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-822a4bc9-8ca6-4355-b3f8-4141e93f59c6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:18.481952 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-822a4bc9-8ca6-4355-b3f8-4141e93f59c6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:18.566744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-822a4bc9-8ca6-4355-b3f8-4141e93f59c6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098604 May 13 12:58:18.573448 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 197/419] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:58:18 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:19.126699 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:19.127319 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:19.133645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.134201 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.134992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.135442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.353127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:19.360600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e353fc59-5b76-4e49-b603-69dcbeb334eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1656 microversion: 2.1 time: 0.237851 May 13 12:58:19.361215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 223/420] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:19 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1656 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:19.378576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-793500ee-756b-42a0-9112-5167a7ae37e0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:19.384824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-793500ee-756b-42a0-9112-5167a7ae37e0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.385317 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-793500ee-756b-42a0-9112-5167a7ae37e0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.445525 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-793500ee-756b-42a0-9112-5167a7ae37e0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Going to try to start instance {{(pid=123409) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 12:58:19.457037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f2f657f4-69b5-40b3-91c1-1cf343999ca7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:19.457543 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f2f657f4-69b5-40b3-91c1-1cf343999ca7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:19.464303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2f657f4-69b5-40b3-91c1-1cf343999ca7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.464958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2f657f4-69b5-40b3-91c1-1cf343999ca7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.465769 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2f657f4-69b5-40b3-91c1-1cf343999ca7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.466366 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f2f657f4-69b5-40b3-91c1-1cf343999ca7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.493148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-793500ee-756b-42a0-9112-5167a7ae37e0 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action" status: 202 len: 0 microversion: 2.1 time: 0.118432 May 13 12:58:19.494058 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 198/421] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 12:58:19 2022] POST /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:58:19.499210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f2f657f4-69b5-40b3-91c1-1cf343999ca7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments/fee88bac-60f4-4ddb-94c0-b703d8350c43" status: 200 len: 194 microversion: 2.20 time: 0.045999 May 13 12:58:19.500280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 224/422] 10.222.0.49 () {60 vars in 1453 bytes} [Fri May 13 12:58:19 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments/fee88bac-60f4-4ddb-94c0-b703d8350c43 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 12:58:19.503951 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:19.504836 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:19.511748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.512170 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.513258 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.513710 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.576244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:19.577301 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:19.589435 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.592131 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.593269 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.593901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.688522 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lazy-loading 'services' on Instance uuid 83873f65-ba42-4536-9af6-4aff1db77bb4 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:58:19.779075 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:19.791105 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fda840ac-e337-4bf2-ab87-34945bdfd155 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1665 microversion: 2.1 time: 0.290995 May 13 12:58:19.793029 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 199/423] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:19 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1665 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:19.793412 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-eae8eb0e-b0ea-49c3-9256-5a565f7b142e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments/fee88bac-60f4-4ddb-94c0-b703d8350c43" status: 202 len: 0 microversion: 2.20 time: 0.220443 May 13 12:58:19.794261 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 225/424] 10.222.0.49 () {60 vars in 1456 bytes} [Fri May 13 12:58:19 2022] DELETE /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments/fee88bac-60f4-4ddb-94c0-b703d8350c43 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 12:58:19.806531 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e1d3e533-4f90-45c3-83ae-49ca3a37814e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:19.808125 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e1d3e533-4f90-45c3-83ae-49ca3a37814e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:19.809285 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-03b39cc9-8325-46dd-9fb4-8b2bd6c17747 req-7420a754-06ae-476c-9193-1bad40bf8623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70fd3419-f741-4630-b0a8-288fd40f27d0", "tag": "b7816347-fb88-41c1-b266-5d5b1c98bb4b"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:19.816359 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1d3e533-4f90-45c3-83ae-49ca3a37814e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.816919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1d3e533-4f90-45c3-83ae-49ca3a37814e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.818618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1d3e533-4f90-45c3-83ae-49ca3a37814e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.818747 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1d3e533-4f90-45c3-83ae-49ca3a37814e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.824386 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-03b39cc9-8325-46dd-9fb4-8b2bd6c17747 req-7420a754-06ae-476c-9193-1bad40bf8623 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:19.825012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-03b39cc9-8325-46dd-9fb4-8b2bd6c17747 req-7420a754-06ae-476c-9193-1bad40bf8623 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:19.840809 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-03b39cc9-8325-46dd-9fb4-8b2bd6c17747 req-7420a754-06ae-476c-9193-1bad40bf8623 service nova] Creating event network-changed:b7816347-fb88-41c1-b266-5d5b1c98bb4b for instance 70fd3419-f741-4630-b0a8-288fd40f27d0 on hv-cinder-84164 May 13 12:58:19.845987 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-03b39cc9-8325-46dd-9fb4-8b2bd6c17747 req-7420a754-06ae-476c-9193-1bad40bf8623 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051385 May 13 12:58:19.850090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 200/425] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:19.864118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e1d3e533-4f90-45c3-83ae-49ca3a37814e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063651 May 13 12:58:19.864711 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 226/426] 10.222.0.49 () {60 vars in 1342 bytes} [Fri May 13 12:58:19 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 12:58:20.362738 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-4294b1a7-a113-42a3-8c76-e8fb0e87a196 req-b6c67fa1-c3ad-465a-8670-43730b0a2810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d6f955-cec3-41be-b4c3-c1ab08771e24", "tag": "c221412b-60f8-4ab0-b29a-df7ab68bd041"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:20.372064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-4294b1a7-a113-42a3-8c76-e8fb0e87a196 req-b6c67fa1-c3ad-465a-8670-43730b0a2810 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:20.372064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-4294b1a7-a113-42a3-8c76-e8fb0e87a196 req-b6c67fa1-c3ad-465a-8670-43730b0a2810 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:20.385675 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-4294b1a7-a113-42a3-8c76-e8fb0e87a196 req-b6c67fa1-c3ad-465a-8670-43730b0a2810 service nova] Creating event network-changed:c221412b-60f8-4ab0-b29a-df7ab68bd041 for instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 on hv-cinder-84164 May 13 12:58:20.392074 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-4294b1a7-a113-42a3-8c76-e8fb0e87a196 req-b6c67fa1-c3ad-465a-8670-43730b0a2810 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033158 May 13 12:58:20.393346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 201/427] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:20.810487 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:20.811777 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:20.822281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:20.822952 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:20.824004 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:20.824451 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:20.877549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b6cbba9e-832e-4aab-b087-f94c07f77082 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:20.878944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b6cbba9e-832e-4aab-b087-f94c07f77082 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:20.886658 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b6cbba9e-832e-4aab-b087-f94c07f77082 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:20.887244 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b6cbba9e-832e-4aab-b087-f94c07f77082 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:20.888259 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b6cbba9e-832e-4aab-b087-f94c07f77082 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:20.888884 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b6cbba9e-832e-4aab-b087-f94c07f77082 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:20.953696 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b6cbba9e-832e-4aab-b087-f94c07f77082 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081255 May 13 12:58:20.954747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 202/428] 10.222.0.49 () {60 vars in 1342 bytes} [Fri May 13 12:58:20 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:58:21.026674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:21.027461 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:21.035438 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:21.036235 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:21.036380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:21.038009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:21.038667 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:21.044557 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-72182045-0e25-40cf-b85b-39699418aa4c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1665 microversion: 2.1 time: 0.238229 May 13 12:58:21.045062 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 227/429] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:20 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1665 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:21.070549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:58:21.154497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-12c2cbb9-6e15-49c7-a740-775f683a73a5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 204 len: 0 microversion: 2.20 time: 0.134573 May 13 12:58:21.155233 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 203/430] 10.222.0.49 () {60 vars in 1279 bytes} [Fri May 13 12:58:21 2022] DELETE /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 12:58:21.163665 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:21.164318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:21.172757 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:21.173427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:21.174033 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:21.174483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:21.309521 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:21.317180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:21.318676 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:21.319823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a491a91f-8f36-46ac-9ab4-260f31046cf0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.160096 May 13 12:58:21.320376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 228/431] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:21 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:22.063032 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:22.063744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:22.070183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:22.071259 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:22.072175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:22.072621 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:22.211196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:22.219257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1847c6ce-81fa-4d8c-8816-455961222372 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1665 microversion: 2.1 time: 0.160568 May 13 12:58:22.219827 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 204/432] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:22 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:22.339644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:22.340262 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:22.346887 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:22.347339 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:22.348108 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:22.348546 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:22.475791 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:22.483647 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:22.485190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:22.486354 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a656c52c-6b44-40d8-8fa0-71fb531ebc91 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.151635 May 13 12:58:22.486919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 229/433] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:22 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:23.235856 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:23.236389 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:23.242902 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:23.243434 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:23.244210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:23.244651 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:23.375099 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:23.382285 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8e430234-7a11-42cc-ba77-7df9009f7101 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1669 microversion: 2.1 time: 0.150362 May 13 12:58:23.383113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 205/434] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:23 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:58:23.505486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:23.505998 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:23.512911 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:23.513397 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:23.514182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:23.514629 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:23.772394 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:23.781723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:23.783037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:23.784214 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b182abb1-cdbc-406c-9ed9-afbad2e8b546 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1723 microversion: 2.20 time: 0.283032 May 13 12:58:23.784862 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 230/435] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:23 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:24.457209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-8f1e3592-9e45-415a-9fdd-4f65075bee8d req-82cebd04-26c6-4627-ba92-51c9640ba3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83873f65-ba42-4536-9af6-4aff1db77bb4", "name": "network-vif-deleted", "tag": "312207b7-e73e-4ced-8336-af184bb733a6"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:24.466077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-8f1e3592-9e45-415a-9fdd-4f65075bee8d req-82cebd04-26c6-4627-ba92-51c9640ba3bf service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:24.466527 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-8f1e3592-9e45-415a-9fdd-4f65075bee8d req-82cebd04-26c6-4627-ba92-51c9640ba3bf service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:24.477087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-8f1e3592-9e45-415a-9fdd-4f65075bee8d req-82cebd04-26c6-4627-ba92-51c9640ba3bf service nova] Creating event network-vif-deleted:312207b7-e73e-4ced-8336-af184bb733a6 for instance 83873f65-ba42-4536-9af6-4aff1db77bb4 on hv-cinder-84164 May 13 12:58:24.481989 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-8f1e3592-9e45-415a-9fdd-4f65075bee8d req-82cebd04-26c6-4627-ba92-51c9640ba3bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028428 May 13 12:58:24.483459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 206/436] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:24.804232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:24.804845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:24.811154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:24.811602 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:24.812374 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:24.812804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:24.843559 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:24.844003 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:24.844445 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lazy-loading 'fault' on Instance uuid 83873f65-ba42-4536-9af6-4aff1db77bb4 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:58:24.885736 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:24.893557 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:24.895073 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:24.896239 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-060e4be6-d750-4213-b0a6-0c596b09c499 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 200 len: 1371 microversion: 2.20 time: 0.097206 May 13 12:58:24.896849 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 231/437] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:24 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:25.917373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:25.918078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:25.924223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:25.924679 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:25.925493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:25.925940 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:25.939473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] HTTP exception thrown: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Request method failure captured: May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 HTTP/1.1 May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflULVlIYHu-77_74ptDCl33-OqE2cFG2ZLef-hFkiaRBVg9Wj1_oIe_IHxRmG4vdDklMFyXni9-y-Evqd3te3xn2ynCnAfHF3nDQwmYnKWresfTyiWH2VYnW0Gw8_Wi2Yh-wtkA0bpU3hSSB7AAPdx45MGAUIYEtC50wiYemq5p76BI May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Openstack-Nova-Api-Version: 2.20 May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:58:25.941119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b148a16abbc49ed816ed45fc1ad4980", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-181270742 May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: e9eb9ff59bef4adb83fbb4c5b358280a May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 12:58:25.942762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '83873f65-ba42-4536-9af6-4aff1db77bb4'} May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:58:25.943666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 12:58:25.945175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:58:25.946606 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Returning 404 to user: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:58:25.946606 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-17d3b66c-8fb8-4867-beb7-bb15aaee858f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 404 len: 111 microversion: 2.20 time: 0.030468 May 13 12:58:25.946606 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 207/438] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:25 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 12:58:25.951361 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-85c46f22-f49c-462e-ad6f-8d1dbc2dfc7e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '.version_select at 0x7f06020430d0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:25.969987 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-85c46f22-f49c-462e-ad6f-8d1dbc2dfc7e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-557763016" status: 204 len: 0 microversion: 2.20 time: 0.022219 May 13 12:58:25.973800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 232/439] 10.222.0.49 () {60 vars in 1258 bytes} [Fri May 13 12:58:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-557763016 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 12:58:26.593132 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e5e7d1bd-f292-4256-896c-9aa97ce98f94 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'create', calling method: .version_select at 0x7f0601f70550>, body: {"keypair": {"name": "tempest-keypair-1385620795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLETwXlPBRgmpUF17jSd27/HpgF1+Qvak6tCUdl6gbIIJveVtSW0DFhyvo9ga976fZCTA5R6YMnUkKKsHMJzCukI1kI8UJ/z5Y4AjiSZ2QovkRAc+9QUepi+F6gxrnEJuw=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:26.607473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-e5e7d1bd-f292-4256-896c-9aa97ce98f94 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:58:26.611271 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-e5e7d1bd-f292-4256-896c-9aa97ce98f94 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for user e9eb9ff59bef4adb83fbb4c5b358280a and project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:58:26.634006 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e5e7d1bd-f292-4256-896c-9aa97ce98f94 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044331 May 13 12:58:26.634749 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 208/440] 10.222.0.49 () {62 vars in 1199 bytes} [Fri May 13 12:58:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 12:58:27.857873 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1610033354", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2600954f-368e-4b9b-9fca-a1e49f9c5d94"}], "security_groups": [{"name": "tempest-securitygroup--1625753446"}], "key_name": "tempest-keypair-1385620795", "user_data": "}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:27.954858 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] validate_networks() for [('2600954f-368e-4b9b-9fca-a1e49f9c5d94', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:58:28.312484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:58:28.312935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:58:28.313450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:58:28.314147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:58:28.314575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:58:28.323129 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:28.323585 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:28.324400 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:28.324845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:28.340886 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:58:28.345006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Getting quotas for user e9eb9ff59bef4adb83fbb4c5b358280a and project 0b148a16abbc49ed816ed45fc1ad4980. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:58:28.356705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:58:28.358994 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:58:28.404218 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c8567afc-2f64-422e-904b-8de2f171ff32 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.550729 May 13 12:58:28.404878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 233/441] 10.222.0.49 () {62 vars in 1187 bytes} [Fri May 13 12:58:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 12:58:28.415530 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2b72997a-06c9-4168-b8a7-5eaf04549ab6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:28.416854 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2b72997a-06c9-4168-b8a7-5eaf04549ab6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:28.475971 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2b72997a-06c9-4168-b8a7-5eaf04549ab6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:28.484031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2b72997a-06c9-4168-b8a7-5eaf04549ab6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:28.485577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2b72997a-06c9-4168-b8a7-5eaf04549ab6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:28.486700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2b72997a-06c9-4168-b8a7-5eaf04549ab6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1282 microversion: 2.20 time: 0.075574 May 13 12:58:28.487260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 209/442] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:28 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:29.506004 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:29.506626 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:29.513204 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:29.513652 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:29.514431 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:29.514865 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:29.597374 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:29.605848 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:29.607350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:29.608455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e22a6e24-474d-41b9-b3f9-44a94a66e6ee tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1352 microversion: 2.20 time: 0.107251 May 13 12:58:29.609049 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 234/443] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:29 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:30.626484 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:30.627111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:30.633780 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:30.634232 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:30.635624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:30.636057 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:30.767366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:30.775874 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:30.778156 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:30.779505 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8c01cfaf-e095-4f95-ac55-f13a61c55f16 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1408 microversion: 2.20 time: 0.156981 May 13 12:58:30.780186 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 210/444] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:30 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:30.966502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-32fb871c-4105-44f3-b255-5099a8f42d4b req-b9b236a6-af58-4a3f-8941-d03574b6429e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6707c346-88db-4146-b776-e3e370c709d5", "tag": "2e9af4d2-bc43-4cbb-989c-99de3b22e35f"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:30.987161 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-32fb871c-4105-44f3-b255-5099a8f42d4b req-b9b236a6-af58-4a3f-8941-d03574b6429e service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:30.987617 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-32fb871c-4105-44f3-b255-5099a8f42d4b req-b9b236a6-af58-4a3f-8941-d03574b6429e service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:31.011453 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-32fb871c-4105-44f3-b255-5099a8f42d4b req-b9b236a6-af58-4a3f-8941-d03574b6429e service nova] Creating event network-changed:2e9af4d2-bc43-4cbb-989c-99de3b22e35f for instance 6707c346-88db-4146-b776-e3e370c709d5 on hv-cinder-84164 May 13 12:58:31.016412 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-32fb871c-4105-44f3-b255-5099a8f42d4b req-b9b236a6-af58-4a3f-8941-d03574b6429e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055572 May 13 12:58:31.020230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 235/445] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:31.797948 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:31.798561 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:31.804868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:31.805438 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:31.806214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:31.806743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:31.933287 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:31.940904 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:31.942424 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:31.943535 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ab9aec59-7c07-4873-a29a-b2324aee4ebc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1408 microversion: 2.20 time: 0.149504 May 13 12:58:31.944098 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 211/446] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:31 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:32.963794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:32.964611 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:32.971181 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:32.971638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:32.972434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:32.972875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:33.303266 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:33.311011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:33.312504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:33.313645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9927880d-74a5-4bf6-9854-147f2bb89b0a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1408 microversion: 2.20 time: 0.355221 May 13 12:58:33.314204 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 236/447] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:32 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:34.331523 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:34.332137 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:34.339377 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:34.339825 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:34.340590 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:34.341056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:34.465210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:34.472930 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:34.474459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:34.475564 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-534b74c4-46ff-4fef-b79a-92607fff245f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1408 microversion: 2.20 time: 0.147909 May 13 12:58:34.476111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 212/448] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:34 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:35.500390 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:35.501047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:35.508576 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:35.509063 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:35.510806 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:35.511249 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:35.647343 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:35.655193 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:35.656942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:35.658067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b004e519-3aca-405e-941c-5dccc0cca0f0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1408 microversion: 2.20 time: 0.161642 May 13 12:58:35.658637 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 237/449] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:35 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:36.243292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-b208025a-91c2-456e-807d-9f974120fb06 req-1d8cc3cc-a0a7-4208-a8ca-ed600c83002a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6707c346-88db-4146-b776-e3e370c709d5", "name": "network-vif-plugged", "status": "completed", "tag": "2e9af4d2-bc43-4cbb-989c-99de3b22e35f"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:36.253252 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-b208025a-91c2-456e-807d-9f974120fb06 req-1d8cc3cc-a0a7-4208-a8ca-ed600c83002a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:36.253902 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-b208025a-91c2-456e-807d-9f974120fb06 req-1d8cc3cc-a0a7-4208-a8ca-ed600c83002a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:36.266622 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-b208025a-91c2-456e-807d-9f974120fb06 req-1d8cc3cc-a0a7-4208-a8ca-ed600c83002a service nova] Creating event network-vif-plugged:2e9af4d2-bc43-4cbb-989c-99de3b22e35f for instance 6707c346-88db-4146-b776-e3e370c709d5 on hv-cinder-84164 May 13 12:58:36.271594 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-b208025a-91c2-456e-807d-9f974120fb06 req-1d8cc3cc-a0a7-4208-a8ca-ed600c83002a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031991 May 13 12:58:36.272410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 213/450] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:36.676322 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:36.676958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:36.683689 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:36.684133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:36.684893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:36.685366 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:36.811647 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:36.819398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:36.820908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:36.822040 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2b160942-5553-4be8-9962-f2eebe646b33 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1408 microversion: 2.20 time: 0.149639 May 13 12:58:36.822612 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 238/451] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:36 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:37.842613 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:37.843321 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:37.849498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:37.849954 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:37.850734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:37.851181 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:37.984152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:37.991860 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:37.993382 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:37.994516 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-bd511965-6f2b-4d06-a278-02ac3be39ebd tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1408 microversion: 2.20 time: 0.157901 May 13 12:58:37.995097 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 214/452] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:37 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:39.012078 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:39.012697 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:39.019043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:39.019502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:39.020274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:39.020717 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:39.149646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:39.158376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:39.159871 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:39.161052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a356ed3a-c5a1-4224-ab93-78bb97772579 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1600 microversion: 2.20 time: 0.153289 May 13 12:58:39.161618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 239/453] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:58:39 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:58:39.178846 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f5eca587-feda-42fd-bd9e-431e965e1152 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:39.179342 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f5eca587-feda-42fd-bd9e-431e965e1152 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:39.185353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5eca587-feda-42fd-bd9e-431e965e1152 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:39.185832 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5eca587-feda-42fd-bd9e-431e965e1152 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:39.186605 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5eca587-feda-42fd-bd9e-431e965e1152 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:39.187045 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f5eca587-feda-42fd-bd9e-431e965e1152 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:39.261846 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f5eca587-feda-42fd-bd9e-431e965e1152 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086090 May 13 12:58:39.262293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 215/454] 10.222.0.49 () {60 vars in 1315 bytes} [Fri May 13 12:58:39 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 12:58:40.206445 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-9999c753-fbe1-4ae6-bca3-c29f2f52c726 req-07db5392-1bfc-44d3-960b-6cd2acb8ab9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6707c346-88db-4146-b776-e3e370c709d5", "tag": "2e9af4d2-bc43-4cbb-989c-99de3b22e35f"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:58:40.215449 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9999c753-fbe1-4ae6-bca3-c29f2f52c726 req-07db5392-1bfc-44d3-960b-6cd2acb8ab9d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:40.215898 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9999c753-fbe1-4ae6-bca3-c29f2f52c726 req-07db5392-1bfc-44d3-960b-6cd2acb8ab9d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:40.226655 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-9999c753-fbe1-4ae6-bca3-c29f2f52c726 req-07db5392-1bfc-44d3-960b-6cd2acb8ab9d service nova] Creating event network-changed:2e9af4d2-bc43-4cbb-989c-99de3b22e35f for instance 6707c346-88db-4146-b776-e3e370c709d5 on hv-cinder-84164 May 13 12:58:40.231998 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-9999c753-fbe1-4ae6-bca3-c29f2f52c726 req-07db5392-1bfc-44d3-960b-6cd2acb8ab9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029082 May 13 12:58:40.232745 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 240/455] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:56.388040 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:56.388966 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:56.394925 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:56.395370 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:56.396130 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:56.396564 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:56.474191 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lazy-loading 'services' on Instance uuid 01d6f955-cec3-41be-b4c3-c1ab08771e24 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:58:56.544126 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6c0069d0-a0f5-407b-a591-c03fe2f0d09f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments/ad1332f0-5aef-4dff-8601-6a265a1a44fa" status: 202 len: 0 microversion: 2.1 time: 0.160942 May 13 12:58:56.544725 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 216/456] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 12:58:56 2022] DELETE /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments/ad1332f0-5aef-4dff-8601-6a265a1a44fa => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:58:56.553599 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0f11a7ff-8d4d-485e-aff6-40a91b50fc8d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:56.554621 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0f11a7ff-8d4d-485e-aff6-40a91b50fc8d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:56.561275 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f11a7ff-8d4d-485e-aff6-40a91b50fc8d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:56.561762 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f11a7ff-8d4d-485e-aff6-40a91b50fc8d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:56.562550 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f11a7ff-8d4d-485e-aff6-40a91b50fc8d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:56.563210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0f11a7ff-8d4d-485e-aff6-40a91b50fc8d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:56.595378 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0f11a7ff-8d4d-485e-aff6-40a91b50fc8d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046099 May 13 12:58:56.595870 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 241/457] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:58:56 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:57.608019 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-905fdf14-eb86-4f51-aa78-69bf462d346b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:57.609102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-905fdf14-eb86-4f51-aa78-69bf462d346b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:57.615148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-905fdf14-eb86-4f51-aa78-69bf462d346b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:57.615616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-905fdf14-eb86-4f51-aa78-69bf462d346b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:57.616613 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-905fdf14-eb86-4f51-aa78-69bf462d346b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:57.617207 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-905fdf14-eb86-4f51-aa78-69bf462d346b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:57.647142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-905fdf14-eb86-4f51-aa78-69bf462d346b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 May 13 12:58:57.647691 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 217/458] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:58:57 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:58:58.659042 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-24799ca6-83da-49ce-b391-2fcb2d60bc33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:58.659962 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-24799ca6-83da-49ce-b391-2fcb2d60bc33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:58.666315 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24799ca6-83da-49ce-b391-2fcb2d60bc33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:58.666778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24799ca6-83da-49ce-b391-2fcb2d60bc33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:58.668317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24799ca6-83da-49ce-b391-2fcb2d60bc33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:58.668752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24799ca6-83da-49ce-b391-2fcb2d60bc33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:58.696419 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-24799ca6-83da-49ce-b391-2fcb2d60bc33 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041553 May 13 12:58:58.696996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 242/459] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:58:58 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 12:58:58.768808 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:58.769384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:58.775340 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:58.775798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:58.777160 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:58.777610 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:58.801722 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:58:58.874697 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1acf6974-6815-4010-b2f4-4b2aff9b2a9a tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 204 len: 0 microversion: 2.1 time: 0.109131 May 13 12:58:58.875366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 218/460] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:58:58 2022] DELETE /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 12:58:58.883360 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:58:58.883976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:58:58.890692 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:58.891147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:58.891954 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:58:58.892393 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:58:59.019608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:58:59.027630 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-000122b4-4e08-463e-b2ba-4853c16665f7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1689 microversion: 2.1 time: 0.148160 May 13 12:58:59.028203 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 243/461] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:58:58 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:00.045008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:00.045723 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:00.051960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:00.052406 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:00.053202 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:00.053641 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:00.178881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:00.186842 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f0b947d4-2372-4154-a059-d67866ef427d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1689 microversion: 2.1 time: 0.146242 May 13 12:59:00.187413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 219/462] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:00 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:01.210823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:01.211437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:01.218490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:01.218975 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:01.219748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:01.220216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:01.345700 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:01.352931 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f8583413-063a-472e-af97-1ade3950c198 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1689 microversion: 2.1 time: 0.145935 May 13 12:59:01.353559 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 244/463] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:01 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:02.315666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d88ada42-279f-4dc2-9256-9804bb2681a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:02.316634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d88ada42-279f-4dc2-9256-9804bb2681a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:02.322959 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d88ada42-279f-4dc2-9256-9804bb2681a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.323405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d88ada42-279f-4dc2-9256-9804bb2681a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.324222 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d88ada42-279f-4dc2-9256-9804bb2681a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.324701 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d88ada42-279f-4dc2-9256-9804bb2681a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.352129 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d88ada42-279f-4dc2-9256-9804bb2681a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040426 May 13 12:59:02.352683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 220/464] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:59:02 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 12:59:02.370146 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:02.370769 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:02.377198 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.377649 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.378420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.378855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.410139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:02.410635 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:02.416636 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.417117 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.417983 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.419395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.445634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:59:02.514996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:02.521912 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-847bc6d5-8f6f-4e33-b16e-1cb8ede9ebc9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 204 len: 0 microversion: 2.1 time: 0.115471 May 13 12:59:02.522457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 221/465] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:59:02 2022] DELETE /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 12:59:02.522589 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-473d33e4-1d11-496a-894a-0fee9c3bf838 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1689 microversion: 2.1 time: 0.156381 May 13 12:59:02.523027 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 245/466] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:02 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:02.531227 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:02.531934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:02.537987 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.538443 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.539244 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:02.539684 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:02.669900 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:02.677272 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f40b7f19-6041-4a12-96ef-cd7e17853d7d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1675 microversion: 2.1 time: 0.150551 May 13 12:59:02.677870 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 222/467] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:02 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:03.540183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:03.540798 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:03.547739 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:03.548190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:03.548997 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:03.549435 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:03.676391 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:03.683635 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e20e4d8a-dec6-4b1c-a3c9-4a217d0b152d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1689 microversion: 2.1 time: 0.147353 May 13 12:59:03.684298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 246/468] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:03 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:03.694136 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:03.694754 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:03.701388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:03.701849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:03.702649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:03.703222 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:03.831100 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:03.840911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-66737706-11af-41b4-ba95-2dfd98aea6eb tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1675 microversion: 2.1 time: 0.150406 May 13 12:59:03.841608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 223/469] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:03 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:03.988153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1f36cbb3-2e94-4c4d-92b1-d3ecce846070 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:03.988687 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1f36cbb3-2e94-4c4d-92b1-d3ecce846070 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:03.994684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f36cbb3-2e94-4c4d-92b1-d3ecce846070 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:03.995143 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f36cbb3-2e94-4c4d-92b1-d3ecce846070 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:03.995917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f36cbb3-2e94-4c4d-92b1-d3ecce846070 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:03.996574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1f36cbb3-2e94-4c4d-92b1-d3ecce846070 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:04.019543 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1f36cbb3-2e94-4c4d-92b1-d3ecce846070 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/ips" status: 200 len: 149 microversion: 2.1 time: 0.035251 May 13 12:59:04.020154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 247/470] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 12:59:03 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:04.700255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:04.700873 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:04.707246 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:04.707700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:04.708473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:04.708913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:04.840376 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:04.847922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-28f3384e-a70c-4a18-a365-2efa71626151 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1689 microversion: 2.1 time: 0.152238 May 13 12:59:04.848488 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 224/471] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:04 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:04.860262 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:04.860883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:04.867404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:04.867857 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:04.868624 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:04.869091 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:05.064971 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:05.073545 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6b9b3a83-1f8e-4a1d-9a21-032671f68548 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1675 microversion: 2.1 time: 0.217804 May 13 12:59:05.074346 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 248/472] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:04 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:05.329971 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8aed7e1b-9e99-4fad-b426-8dfead1035e1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f7d7659-eb36-4dc7-8aef-920d9f10f13a"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:05.332035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8aed7e1b-9e99-4fad-b426-8dfead1035e1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:05.339465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8aed7e1b-9e99-4fad-b426-8dfead1035e1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:05.340539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8aed7e1b-9e99-4fad-b426-8dfead1035e1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:05.341676 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8aed7e1b-9e99-4fad-b426-8dfead1035e1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:05.342199 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8aed7e1b-9e99-4fad-b426-8dfead1035e1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:05.638383 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8aed7e1b-9e99-4fad-b426-8dfead1035e1 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312256 May 13 12:59:05.639578 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 225/473] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:59:05 2022] POST /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:05.865953 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:05.867291 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:05.873379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-7e178027-cc16-4a11-af08-afb4bbeed337 req-8800f403-599b-495e-82cb-5f4656643533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d6f955-cec3-41be-b4c3-c1ab08771e24", "name": "network-vif-deleted", "tag": "c221412b-60f8-4ab0-b29a-df7ab68bd041"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:05.885396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7e178027-cc16-4a11-af08-afb4bbeed337 req-8800f403-599b-495e-82cb-5f4656643533 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:05.886306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7e178027-cc16-4a11-af08-afb4bbeed337 req-8800f403-599b-495e-82cb-5f4656643533 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:05.887843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:05.893926 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:05.894851 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:05.896493 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:05.912775 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-7e178027-cc16-4a11-af08-afb4bbeed337 req-8800f403-599b-495e-82cb-5f4656643533 service nova] Creating event network-vif-deleted:c221412b-60f8-4ab0-b29a-df7ab68bd041 for instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 on hv-cinder-84164 May 13 12:59:05.919181 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-7e178027-cc16-4a11-af08-afb4bbeed337 req-8800f403-599b-495e-82cb-5f4656643533 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050291 May 13 12:59:05.919780 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 226/474] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:59:06.047212 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:06.055740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4f122779-4cfd-40a5-aead-7ee46b4ef396 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 200 len: 1622 microversion: 2.1 time: 0.194219 May 13 12:59:06.057655 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 249/475] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:05 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 1622 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:06.094145 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:06.094961 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:06.110772 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:06.111394 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:06.112251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:06.112899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:06.191822 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:06.202185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-64f75204-c9ea-4ab4-9b4f-d42b11fbc62c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 200 len: 1607 microversion: 2.1 time: 0.114975 May 13 12:59:06.216864 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 227/476] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:06 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 1607 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:06.412114 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-e5be1814-4512-4748-8251-5ca6dbd8e0db req-718b4d02-094d-4789-85f4-e4b21766d715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a805ac8a-8fbf-4bf1-b369-64eaef204809", "name": "network-vif-deleted", "tag": "fec89e37-51dd-4063-9de3-e584ce441fb2"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:06.420806 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e5be1814-4512-4748-8251-5ca6dbd8e0db req-718b4d02-094d-4789-85f4-e4b21766d715 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:06.421573 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e5be1814-4512-4748-8251-5ca6dbd8e0db req-718b4d02-094d-4789-85f4-e4b21766d715 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:06.433136 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-e5be1814-4512-4748-8251-5ca6dbd8e0db req-718b4d02-094d-4789-85f4-e4b21766d715 service nova] Creating event network-vif-deleted:fec89e37-51dd-4063-9de3-e584ce441fb2 for instance a805ac8a-8fbf-4bf1-b369-64eaef204809 on hv-cinder-84164 May 13 12:59:06.438241 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-e5be1814-4512-4748-8251-5ca6dbd8e0db req-718b4d02-094d-4789-85f4-e4b21766d715 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029783 May 13 12:59:06.442296 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 250/477] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:07.074582 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:07.075359 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 01d6f955-cec3-41be-b4c3-c1ab08771e24] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:07.081739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:07.082194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:07.082971 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:07.083410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:07.097302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] HTTP exception thrown: Instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 could not be found. May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Request method failure captured: May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 HTTP/1.1 May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUX6d6ZDKe_nV9YYJJ-Xgg5nq_eQ3qvvcgCeINIKbafVPAIxtWuud204p2x-5jTuIcu4tEnOLvL-XOxslje6BHnGbrbs9z9B_oA_4fgBX5U-tG-0VDQcSFULd0UkNyRJUKeO4CldWqBU_j9rU8l9IFocTMVLdpP7wQR4AMFIFaIgc8 May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:59:07.099266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_58bddca6077344bea4cb41b23fcf8d35", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: fbad87a0396f4deb92f4da676af8bfdb May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 could not be found. May 13 12:59:07.100640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '01d6f955-cec3-41be-b4c3-c1ab08771e24'} May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 could not be found. May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:59:07.101413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 could not be found. May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 could not be found. May 13 12:59:07.102702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.103790 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Returning 404 to user: Instance 01d6f955-cec3-41be-b4c3-c1ab08771e24 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:59:07.103790 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-19e8ee1c-567d-4b4b-a636-51c0c537c3b7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24" status: 404 len: 111 microversion: 2.1 time: 0.030290 May 13 12:59:07.104671 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 228/478] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:07 2022] GET /compute/v2.1/servers/01d6f955-cec3-41be-b4c3-c1ab08771e24 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:59:07.113937 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b3f99ee4-8837-440e-9917-99eddff2b24d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '.version_select at 0x7f0601fa5790>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:07.138401 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b3f99ee4-8837-440e-9917-99eddff2b24d tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809250639" status: 202 len: 0 microversion: 2.1 time: 0.030540 May 13 12:59:07.139545 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 251/479] 10.222.0.49 () {58 vars in 1220 bytes} [Fri May 13 12:59:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809250639 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:59:07.224833 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:07.225851 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:07.234243 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:07.234960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:07.235984 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:07.236738 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:07.254478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] HTTP exception thrown: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Request method failure captured: May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 HTTP/1.1 May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflVRFhIcQr6hEurLPjf0Keg-nQ98YzlMsCFRZNNPpvvm8bZwV7PCcdSdBH81EPJzqjfCBOxdTcRdODqnB_g4ATH2rp8GzyAbNQaJ1Y0RpTbQps_NLJJrTrJDhJRXk9uIPYT7NA18aySj8sfQhhmiLccHZ61xN2_S0g3kOKUvFUBmE_4 May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: a8e091db3cd14ecb9c40257451cd434d May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:59:07.256048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8e091db3cd14ecb9c40257451cd434d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeTestJSON-1591423219 May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: a8e091db3cd14ecb9c40257451cd434d May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeTestJSON-1591423219-project May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 88bc7138e3d5438b9a96744e22add357 May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeTestJSON-1591423219-project May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 12:59:07.257486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'a805ac8a-8fbf-4bf1-b369-64eaef204809'} May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:59:07.258220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 12:59:07.259365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:07.260391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Returning 404 to user: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:59:07.260391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b2646baa-e865-4269-91be-fb04ece36f8c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 404 len: 111 microversion: 2.1 time: 0.037304 May 13 12:59:07.262370 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 229/480] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:07 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:59:07.267557 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e3b7d6ae-e5cb-4aae-9bd8-1fc805202900 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '.version_select at 0x7f0602005d30>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:07.309684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e3b7d6ae-e5cb-4aae-9bd8-1fc805202900 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954792090" status: 202 len: 0 microversion: 2.1 time: 0.045711 May 13 12:59:07.310744 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 252/481] 10.222.0.49 () {58 vars in 1217 bytes} [Fri May 13 12:59:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954792090 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:59:07.988801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3f0bd3d4-d694-4b47-8979-628c9c7d7bc4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'create', calling method: .version_select at 0x7f06020ec550>, body: {"keypair": {"name": "tempest-keypair-75544264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq3GBZV28SD8K5ayVgrt6uekOqrQ1C+OhUt6VBw2kMnSkOoKYsJGQWuDXGSHD2RVBHNKOFZ9TCTlFqemOjKPj/SvY83NXEleQZ3+96KS6hj+5pDLVjbc0cSKBlBtSP6hg=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:08.002754 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-3f0bd3d4-d694-4b47-8979-628c9c7d7bc4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for project a8e091db3cd14ecb9c40257451cd434d. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:59:08.006578 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-3f0bd3d4-d694-4b47-8979-628c9c7d7bc4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for user 88bc7138e3d5438b9a96744e22add357 and project a8e091db3cd14ecb9c40257451cd434d. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:59:08.028439 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3f0bd3d4-d694-4b47-8979-628c9c7d7bc4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.042773 May 13 12:59:08.029050 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 230/482] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 12:59:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:09.276883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1863925277", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e48d261-a2df-43c6-bd2a-fa0153331d4d"}], "security_groups": [{"name": "tempest-securitygroup--172332481"}], "key_name": "tempest-keypair-75544264", "user_data": "}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:09.384108 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] validate_networks() for [('2e48d261-a2df-43c6-bd2a-fa0153331d4d', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:59:09.739841 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:59:09.740269 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:59:09.740749 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:59:09.741206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:59:09.741621 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:59:09.750608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:09.751051 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:09.751883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:09.752323 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:09.768582 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for project a8e091db3cd14ecb9c40257451cd434d. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:59:09.772410 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Getting quotas for user 88bc7138e3d5438b9a96744e22add357 and project a8e091db3cd14ecb9c40257451cd434d. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:59:09.783755 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:59:09.786164 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:59:09.833127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e9b193f9-7a6e-4c95-932d-954f3a93c507 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.560911 May 13 12:59:09.833706 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 253/483] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:59:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 12:59:09.844324 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-aa83c8e4-6b5c-4f3c-9601-ac43aef15cfe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:09.844936 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-aa83c8e4-6b5c-4f3c-9601-ac43aef15cfe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:09.898801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-aa83c8e4-6b5c-4f3c-9601-ac43aef15cfe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:09.906791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-aa83c8e4-6b5c-4f3c-9601-ac43aef15cfe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1236 microversion: 2.1 time: 0.066841 May 13 12:59:09.907626 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 231/484] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:09 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:10.094778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:10.095284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:10.101383 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:10.101838 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:10.102740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:10.103177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:10.130118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:59:10.218596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-bac83365-26a0-4e84-88f0-70a0947d6ad6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 204 len: 0 microversion: 2.1 time: 0.128103 May 13 12:59:10.219197 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 254/485] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:59:10 2022] DELETE /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 12:59:10.227330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:10.228601 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:10.234335 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:10.234798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:10.235589 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:10.236031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:10.369838 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:10.378139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5fa5c645-1024-4e09-a836-754dca3d8bb7 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1507 microversion: 2.1 time: 0.154818 May 13 12:59:10.378723 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 232/486] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:10 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:10.924422 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:10.925154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:10.931380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:10.931826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:10.932586 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:10.933045 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:10.996397 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:11.003887 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0875b048-5205-4a8e-a3e1-d11ba021dfb3 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1232 microversion: 2.1 time: 0.083732 May 13 12:59:11.004473 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 255/487] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:10 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:11.395920 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:11.396544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:11.403831 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:11.404292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:11.405110 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:11.405558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:11.534052 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:11.541398 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-941e3427-8d8d-4fde-a88d-bb90b7685d84 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1507 microversion: 2.1 time: 0.149269 May 13 12:59:11.541968 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 233/488] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:11 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:12.020452 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:12.021187 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:12.027662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:12.028322 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:12.029169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:12.029615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:12.089050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:12.096264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5070a7c1-ecd3-4b67-bd9d-36e1a03fea39 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1232 microversion: 2.1 time: 0.079563 May 13 12:59:12.096832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 256/489] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:12 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1232 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:12.557611 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:12.558225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:12.565177 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:12.565637 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:12.566407 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:12.566847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:12.695851 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:12.703599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d012928f-0fd9-4949-992c-c195180339b6 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1507 microversion: 2.1 time: 0.149817 May 13 12:59:12.704178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 234/490] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:12 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:13.111938 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:13.112551 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:13.118847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:13.119300 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:13.120066 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:13.120504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:13.184512 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:13.191775 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0d2706d6-d9e2-4eda-859f-9f4d26385046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1288 microversion: 2.1 time: 0.083612 May 13 12:59:13.192342 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 257/491] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:13 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:13.722090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:13.722707 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:13.728969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:13.729446 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:13.730335 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:13.731537 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:13.953513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-38952651-400c-4de5-8e4f-2998d101cd93 req-a114de79-4ff8-4e05-9308-35abb059468a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2825cd-1b9d-4434-bf94-ebf3f6688015", "name": "network-vif-deleted", "tag": "2f8c0546-7559-4827-9638-ab93068addc3"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:13.955381 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:13.963724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-89b01876-f8f8-4e84-8e3d-9afb267eed35 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 200 len: 1507 microversion: 2.1 time: 0.245841 May 13 12:59:13.973219 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 235/492] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:13 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:13.974054 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-38952651-400c-4de5-8e4f-2998d101cd93 req-a114de79-4ff8-4e05-9308-35abb059468a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:13.974731 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-38952651-400c-4de5-8e4f-2998d101cd93 req-a114de79-4ff8-4e05-9308-35abb059468a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.001478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-38952651-400c-4de5-8e4f-2998d101cd93 req-a114de79-4ff8-4e05-9308-35abb059468a service nova] Creating event network-vif-deleted:2f8c0546-7559-4827-9638-ab93068addc3 for instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 on hv-cinder-84164 May 13 12:59:14.008913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-38952651-400c-4de5-8e4f-2998d101cd93 req-a114de79-4ff8-4e05-9308-35abb059468a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060523 May 13 12:59:14.015245 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 258/493] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:59:14.215898 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:14.216696 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:14.218427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f7d7659-eb36-4dc7-8aef-920d9f10f13a"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:14.219593 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:14.222765 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.223214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.223986 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.224545 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.225583 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.226036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.226809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.227254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.291322 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:14.300098 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cbb74921-fc16-4d51-b0d5-b6ac670fe499 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1294 microversion: 2.1 time: 0.088313 May 13 12:59:14.300673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 236/494] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:14 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:14.318838 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Invalid volume: volume 3f7d7659-eb36-4dc7-8aef-920d9f10f13a is already attached to instances: 70fd3419-f741-4630-b0a8-288fd40f27d0 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: POST /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments HTTP/1.1 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 74 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 12:59:14.320683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {"volumeAttachment": {"volumeId": "3f7d7659-eb36-4dc7-8aef-920d9f10f13a"}} May 13 12:59:14.323513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Invalid volume: volume 3f7d7659-eb36-4dc7-8aef-920d9f10f13a is already attached to instances: 70fd3419-f741-4630-b0a8-288fd40f27d0 May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'server_id': '70fd3419-f741-4630-b0a8-288fd40f27d0', 'body': {'volumeAttachment': {'volumeId': '3f7d7659-eb36-4dc7-8aef-920d9f10f13a'}}} May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3f7d7659-eb36-4dc7-8aef-920d9f10f13a is already attached to instances: 70fd3419-f741-4630-b0a8-288fd40f27d0 May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:14.325270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3f7d7659-eb36-4dc7-8aef-920d9f10f13a is already attached to instances: 70fd3419-f741-4630-b0a8-288fd40f27d0 May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:14.327883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3f7d7659-eb36-4dc7-8aef-920d9f10f13a is already attached to instances: 70fd3419-f741-4630-b0a8-288fd40f27d0 May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 400 to user: Invalid volume: volume 3f7d7659-eb36-4dc7-8aef-920d9f10f13a is already attached to instances: 70fd3419-f741-4630-b0a8-288fd40f27d0 {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2bd5c2a0-90f9-4e36-b1b0-0ebb1a805670 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108657 May 13 12:59:14.330782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 259/495] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 12:59:14 2022] POST /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 12:59:14.391614 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:14.392201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:14.398280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.398730 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.399506 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.400124 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.483933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lazy-loading 'services' on Instance uuid 70fd3419-f741-4630-b0a8-288fd40f27d0 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:59:14.558788 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3855dcdc-9f63-45e7-94ce-efd39032da3d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments/3f7d7659-eb36-4dc7-8aef-920d9f10f13a" status: 202 len: 0 microversion: 2.1 time: 0.170882 May 13 12:59:14.560436 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 237/496] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 12:59:14 2022] DELETE /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments/3f7d7659-eb36-4dc7-8aef-920d9f10f13a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:59:14.568795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e1f46242-c628-4e9d-a51e-af5acb9f2131 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:14.570063 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e1f46242-c628-4e9d-a51e-af5acb9f2131 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:14.577823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1f46242-c628-4e9d-a51e-af5acb9f2131 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.578507 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1f46242-c628-4e9d-a51e-af5acb9f2131 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.579460 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1f46242-c628-4e9d-a51e-af5acb9f2131 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.579895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e1f46242-c628-4e9d-a51e-af5acb9f2131 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.614826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e1f46242-c628-4e9d-a51e-af5acb9f2131 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049876 May 13 12:59:14.615318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 260/497] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:59:14 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:59:14.982912 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:14.983650 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: 9f2825cd-1b9d-4434-bf94-ebf3f6688015] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:14.989759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.990217 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:14.990980 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:14.991413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.004836 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] HTTP exception thrown: Instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 could not be found. May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Request method failure captured: May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 HTTP/1.1 May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUX6d6ZDKe_nV9YYJJ-Xgg5nq_eQ3qvvcgCeINIKbafVPAIxtWuud204p2x-5jTuIcu4tEnOLvL-XOxslje6BHnGbrbs9z9B_oA_4fgBX5U-tG-0VDQcSFULd0UkNyRJUKeO4CldWqBU_j9rU8l9IFocTMVLdpP7wQR4AMFIFaIgc8 May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:59:15.007055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_58bddca6077344bea4cb41b23fcf8d35", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: fbad87a0396f4deb92f4da676af8bfdb May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 could not be found. May 13 12:59:15.008513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '9f2825cd-1b9d-4434-bf94-ebf3f6688015'} May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 could not be found. May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:59:15.009297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 could not be found. May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 could not be found. May 13 12:59:15.011020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:15.012118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Returning 404 to user: Instance 9f2825cd-1b9d-4434-bf94-ebf3f6688015 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:59:15.012118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9f1f1fb6-78ce-4a6b-a3ae-19185ad07e45 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015" status: 404 len: 111 microversion: 2.1 time: 0.030272 May 13 12:59:15.012118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 238/498] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:14 2022] GET /compute/v2.1/servers/9f2825cd-1b9d-4434-bf94-ebf3f6688015 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:59:15.017440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:15.017935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:15.024692 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.025165 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.026680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.027122 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.055438 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:59:15.151573 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a2b6877e-e9cf-4cec-996e-448cd5a51f77 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 204 len: 0 microversion: 2.1 time: 0.137483 May 13 12:59:15.163824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 261/499] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:59:15 2022] DELETE /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 12:59:15.172508 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:15.174255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:15.181354 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.181870 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.182675 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.183127 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.319948 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:15.325272 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:15.327755 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:15.332288 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.332755 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.333585 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.334367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.335918 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3c9680b4-8273-4f09-9e47-634dc286a051 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.168206 May 13 12:59:15.337144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 239/500] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:15 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:15.478686 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:15.486918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-30bf40ca-3224-4bcb-a5a2-56e04d68befe tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.172757 May 13 12:59:15.487492 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 262/501] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:15 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:15.627268 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e19238a4-e34a-443b-a99d-d01f2f35a29b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:15.628200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e19238a4-e34a-443b-a99d-d01f2f35a29b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:15.634376 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e19238a4-e34a-443b-a99d-d01f2f35a29b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.634830 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e19238a4-e34a-443b-a99d-d01f2f35a29b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.635618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e19238a4-e34a-443b-a99d-d01f2f35a29b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:15.636063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e19238a4-e34a-443b-a99d-d01f2f35a29b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:15.666288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e19238a4-e34a-443b-a99d-d01f2f35a29b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 May 13 12:59:15.666855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 240/502] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:59:15 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:16.354917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:16.355486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:16.362010 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:16.362750 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:16.363429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:16.363647 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:16.493603 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:16.501973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-65aa8be2-35ea-41ed-a747-1d5c635463f0 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.150951 May 13 12:59:16.502546 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 263/503] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:16 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:59:16.503397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:16.504012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:16.510312 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:16.510762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:16.511527 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:16.512637 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:16.642051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:16.649270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-64b206dd-77ad-4ed0-8fff-aa31f5f7778d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.149600 May 13 12:59:16.649826 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 241/504] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:16 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:59:16.678442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6a5ddf91-fdfc-4d96-9816-26ef8084f8a8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:16.679462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6a5ddf91-fdfc-4d96-9816-26ef8084f8a8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:16.685511 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a5ddf91-fdfc-4d96-9816-26ef8084f8a8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:16.685971 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a5ddf91-fdfc-4d96-9816-26ef8084f8a8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:16.686742 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a5ddf91-fdfc-4d96-9816-26ef8084f8a8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:16.687183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6a5ddf91-fdfc-4d96-9816-26ef8084f8a8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:16.716093 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6a5ddf91-fdfc-4d96-9816-26ef8084f8a8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 May 13 12:59:16.716664 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 264/505] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:59:16 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:17.518489 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:17.519127 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:17.525419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:17.525863 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:17.526622 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:17.527056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:17.653560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:17.661226 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ca2ab61b-7dac-4180-af57-f55eb69841bd tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.146563 May 13 12:59:17.661798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 242/506] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:17 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:17.665566 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:17.666179 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:17.672939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:17.673411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:17.674169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:17.674601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:17.727561 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-133302c0-27ae-4280-a8c0-bf97d879a67e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:17.728558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-133302c0-27ae-4280-a8c0-bf97d879a67e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:17.735138 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-133302c0-27ae-4280-a8c0-bf97d879a67e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:17.735593 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-133302c0-27ae-4280-a8c0-bf97d879a67e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:17.736371 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-133302c0-27ae-4280-a8c0-bf97d879a67e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:17.736809 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-133302c0-27ae-4280-a8c0-bf97d879a67e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:17.765625 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-133302c0-27ae-4280-a8c0-bf97d879a67e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041925 May 13 12:59:17.766202 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 243/507] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:59:17 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:59:17.800830 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:17.808140 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-295c892e-05b5-4845-bb92-80717c3b94ee tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.146435 May 13 12:59:17.809303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 265/508] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:17 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:59:18.678465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:18.679079 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:18.685416 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:18.685871 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:18.686682 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:18.687118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:18.777907 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-141df6fc-2ddc-445e-8fab-44c7658c4cc9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:18.779070 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-141df6fc-2ddc-445e-8fab-44c7658c4cc9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:18.785983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-141df6fc-2ddc-445e-8fab-44c7658c4cc9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:18.786434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-141df6fc-2ddc-445e-8fab-44c7658c4cc9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:18.787219 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-141df6fc-2ddc-445e-8fab-44c7658c4cc9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:18.787655 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-141df6fc-2ddc-445e-8fab-44c7658c4cc9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:18.828067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-141df6fc-2ddc-445e-8fab-44c7658c4cc9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054746 May 13 12:59:18.833626 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 266/509] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 12:59:18 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 12:59:18.840309 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:18.841401 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:18.848093 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:18.848756 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:18.849737 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:18.850740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:18.966784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:18.975113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-da4ae243-8012-448d-96eb-030e34e0ca86 tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1521 microversion: 2.1 time: 0.300411 May 13 12:59:18.977931 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 244/510] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:18 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:18.984791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:18.986620 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:19.000408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:19.001537 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:19.002418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:19.002878 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:19.040883 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 12:59:19.078340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:19.087657 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-464bb67b-3c1e-408f-bf48-81a01f72154d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.252660 May 13 12:59:19.088443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 267/511] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:18 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:19.103703 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-047969d4-8aae-43a3-9800-7e3e8f587f59 req-ec8abc3b-b49c-4eb8-a338-1c55b38ad72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80dc3686-a1be-4e57-8d5a-9d1f94f597d1", "tag": "5ac86e19-cc6f-4364-9f1f-30cab19c886a"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:19.122723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-047969d4-8aae-43a3-9800-7e3e8f587f59 req-ec8abc3b-b49c-4eb8-a338-1c55b38ad72d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:19.123468 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-047969d4-8aae-43a3-9800-7e3e8f587f59 req-ec8abc3b-b49c-4eb8-a338-1c55b38ad72d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:19.139343 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-047969d4-8aae-43a3-9800-7e3e8f587f59 req-ec8abc3b-b49c-4eb8-a338-1c55b38ad72d service nova] Creating event network-changed:5ac86e19-cc6f-4364-9f1f-30cab19c886a for instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 on hv-cinder-84164 May 13 12:59:19.145794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7c51810d-3dd7-456b-90cd-791918a51258 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 204 len: 0 microversion: 2.1 time: 0.165900 May 13 12:59:19.146440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 245/512] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 12:59:18 2022] DELETE /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 12:59:19.147548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-047969d4-8aae-43a3-9800-7e3e8f587f59 req-ec8abc3b-b49c-4eb8-a338-1c55b38ad72d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047836 May 13 12:59:19.149520 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 268/513] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 12:59:19.156393 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:19.157361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:19.165341 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:19.166047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:19.167218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:19.168372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:19.366574 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:19.374654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-525a1cda-d76c-4193-bc06-ea6e046bd3bc tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1680 microversion: 2.1 time: 0.223310 May 13 12:59:19.375174 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 246/514] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:19 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:19.477060 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-5bdd95cd-643d-4911-80b7-abc462c80387 req-4934518a-37eb-433f-bf99-58951b600d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ff36f5-3afb-4239-b817-663ac72e599f", "name": "network-vif-deleted", "tag": "08d00a85-0887-4227-be00-65bf3e7c0381"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:19.485868 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-5bdd95cd-643d-4911-80b7-abc462c80387 req-4934518a-37eb-433f-bf99-58951b600d97 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:19.486310 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-5bdd95cd-643d-4911-80b7-abc462c80387 req-4934518a-37eb-433f-bf99-58951b600d97 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:19.496915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-5bdd95cd-643d-4911-80b7-abc462c80387 req-4934518a-37eb-433f-bf99-58951b600d97 service nova] Creating event network-vif-deleted:08d00a85-0887-4227-be00-65bf3e7c0381 for instance b9ff36f5-3afb-4239-b817-663ac72e599f on hv-cinder-84164 May 13 12:59:19.501681 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-5bdd95cd-643d-4911-80b7-abc462c80387 req-4934518a-37eb-433f-bf99-58951b600d97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028970 May 13 12:59:19.502268 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 269/515] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:19.994481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:19.995048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:20.001526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:20.001939 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:20.002719 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:20.003165 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:20.064583 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:20.071932 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f04a9aae-7eb6-4ead-a203-c7faedad8b6b tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1479 microversion: 2.1 time: 0.081355 May 13 12:59:20.072502 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 247/516] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:19 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1479 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:20.105827 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:20.106644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:20.112748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:20.113238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:20.114012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:20.114456 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:20.241200 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:20.250035 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f7fa2361-7f28-44be-b557-2ac5742baa60 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.148222 May 13 12:59:20.250581 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 270/517] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:20 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:20.394821 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:20.395433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:20.401436 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:20.401890 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:20.403267 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:20.403717 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:20.530782 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:20.538299 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4c29e4bc-98a6-47a3-b4fc-6c610b1ba758 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1680 microversion: 2.1 time: 0.147361 May 13 12:59:20.538899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 248/518] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:20 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:21.089260 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:21.090613 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:21.097263 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:21.097710 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:21.098534 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:21.099176 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:21.131367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:21.132024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:21.132248 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lazy-loading 'fault' on Instance uuid b9ff36f5-3afb-4239-b817-663ac72e599f {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:59:21.172835 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbad87a0396f4deb92f4da676af8bfdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bddca6077344bea4cb41b23fcf8d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:21.180270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-17dce1fb-13cd-49f6-8981-9019e3b02cff tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 200 len: 1312 microversion: 2.1 time: 0.094988 May 13 12:59:21.180860 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 271/519] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:21 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:21.267035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:21.267649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:21.273955 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:21.274410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:21.275178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:21.275617 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:21.443648 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:21.452334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-065ed143-346e-45c9-8310-4a5a8774ac8d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.189144 May 13 12:59:21.452903 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 249/520] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:21 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:21.555743 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:21.556350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:21.562318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:21.562766 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:21.563523 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:21.563957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:21.750820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:21.759168 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-383af3f9-7b17-4bd2-9417-ba39098b1569 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1680 microversion: 2.1 time: 0.207189 May 13 12:59:21.759761 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 272/521] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:21 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:22.196306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:22.196921 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] [instance: b9ff36f5-3afb-4239-b817-663ac72e599f] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:22.203082 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:22.203532 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:22.204299 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:22.204740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:22.218816 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] HTTP exception thrown: Instance b9ff36f5-3afb-4239-b817-663ac72e599f could not be found. May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Request method failure captured: May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f HTTP/1.1 May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUX6d6ZDKe_nV9YYJJ-Xgg5nq_eQ3qvvcgCeINIKbafVPAIxtWuud204p2x-5jTuIcu4tEnOLvL-XOxslje6BHnGbrbs9z9B_oA_4fgBX5U-tG-0VDQcSFULd0UkNyRJUKeO4CldWqBU_j9rU8l9IFocTMVLdpP7wQR4AMFIFaIgc8 May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 12:59:22.220471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_58bddca6077344bea4cb41b23fcf8d35", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58bddca6077344bea4cb41b23fcf8d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 58bddca6077344bea4cb41b23fcf8d35 May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-374346939 May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: fbad87a0396f4deb92f4da676af8bfdb May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-374346939-project May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance b9ff36f5-3afb-4239-b817-663ac72e599f could not be found. May 13 12:59:22.221747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'b9ff36f5-3afb-4239-b817-663ac72e599f'} May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ff36f5-3afb-4239-b817-663ac72e599f could not be found. May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:59:22.222427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ff36f5-3afb-4239-b817-663ac72e599f could not be found. May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ff36f5-3afb-4239-b817-663ac72e599f could not be found. May 13 12:59:22.223536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 12:59:22.224597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] Returning 404 to user: Instance b9ff36f5-3afb-4239-b817-663ac72e599f could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:59:22.224597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-91e70830-5609-42b2-935c-55de9a0de53f tempest-ServerRescueNegativeTestJSON-374346939 tempest-ServerRescueNegativeTestJSON-374346939-project] 10.222.0.49 "GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f" status: 404 len: 111 microversion: 2.1 time: 0.029405 May 13 12:59:22.224597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 250/522] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:22 2022] GET /compute/v2.1/servers/b9ff36f5-3afb-4239-b817-663ac72e599f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:59:22.465848 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-1694b22c-25dd-4d11-b07b-a0bc8b6fc21b req-ff73afdd-1c32-4dc9-9448-3dafa1604110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70fd3419-f741-4630-b0a8-288fd40f27d0", "name": "network-vif-deleted", "tag": "b7816347-fb88-41c1-b266-5d5b1c98bb4b"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:22.470147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:22.471447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:22.477927 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:22.478166 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-1694b22c-25dd-4d11-b07b-a0bc8b6fc21b req-ff73afdd-1c32-4dc9-9448-3dafa1604110 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:22.478757 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:22.479059 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-1694b22c-25dd-4d11-b07b-a0bc8b6fc21b req-ff73afdd-1c32-4dc9-9448-3dafa1604110 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:22.480022 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:22.481324 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:22.492503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-1694b22c-25dd-4d11-b07b-a0bc8b6fc21b req-ff73afdd-1c32-4dc9-9448-3dafa1604110 service nova] Creating event network-vif-deleted:b7816347-fb88-41c1-b266-5d5b1c98bb4b for instance 70fd3419-f741-4630-b0a8-288fd40f27d0 on hv-cinder-84164 May 13 12:59:22.499126 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-1694b22c-25dd-4d11-b07b-a0bc8b6fc21b req-ff73afdd-1c32-4dc9-9448-3dafa1604110 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038339 May 13 12:59:22.503384 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 273/523] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:22.643521 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:22.652833 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e6eb1fba-885a-4b64-bc71-d46d54c841e9 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.187088 May 13 12:59:22.654799 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 251/524] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:22 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:22.778587 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:22.779299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:22.786467 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:22.787213 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:22.788207 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:22.788674 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:22.989089 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:22.998309 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8a370c51-e31f-4617-834e-680a6ec2e48d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 200 len: 1613 microversion: 2.1 time: 0.224866 May 13 12:59:23.006169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 274/525] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:22 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 1613 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:23.688251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:23.688884 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:23.700560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:23.702185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:23.703683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:23.704296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:23.777604 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-adfcaa10-f3a9-4807-9250-2535176c11b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:23.778383 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-adfcaa10-f3a9-4807-9250-2535176c11b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:23.786247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adfcaa10-f3a9-4807-9250-2535176c11b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:23.786990 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adfcaa10-f3a9-4807-9250-2535176c11b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:23.788019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adfcaa10-f3a9-4807-9250-2535176c11b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:23.788909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-adfcaa10-f3a9-4807-9250-2535176c11b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:23.816368 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-adfcaa10-f3a9-4807-9250-2535176c11b2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/ips" status: 200 len: 151 microversion: 2.20 time: 0.045174 May 13 12:59:23.817072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 275/526] 10.222.0.49 () {60 vars in 1288 bytes} [Fri May 13 12:59:23 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 12:59:23.923106 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:23.930319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2259a084-d537-453c-9e75-efe79c485000 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.262890 May 13 12:59:23.930958 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 252/527] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:23 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:24.016260 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:24.016924 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:24.023169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:24.023625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:24.024411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:24.024847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:24.040682 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 HTTP/1.1 May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 12:59:24.042542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 12:59:24.044064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '70fd3419-f741-4630-b0a8-288fd40f27d0'} May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 12:59:24.044902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 12:59:24.046432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 12:59:24.049098 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 12:59:24.050549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d6d406d7-1ece-41cf-95bb-9487e5ee6398 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 404 len: 111 microversion: 2.1 time: 0.038608 May 13 12:59:24.054954 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 276/528] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:24 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 12:59:24.060471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-46cf46ce-6847-480f-8f51-f6a2587385ab tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '.version_select at 0x7f0602181d30>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:24.082670 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-46cf46ce-6847-480f-8f51-f6a2587385ab tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650815642" status: 202 len: 0 microversion: 2.1 time: 0.026147 May 13 12:59:24.083877 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 253/529] 10.222.0.49 () {58 vars in 1220 bytes} [Fri May 13 12:59:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650815642 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 12:59:24.946545 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:24.947122 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:24.954344 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:24.955082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:24.956088 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:24.956884 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:25.230024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:25.238154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a4b0824a-83e8-453e-885b-ba01e8d67911 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.295521 May 13 12:59:25.238718 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 277/530] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:24 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:25.375500 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-47631d6a-ff61-4f2f-85fa-e2954295f87a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: .version_select at 0x7f0601f4ddc0>, body: {"keypair": {"name": "tempest-keypair-2067688971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONLzCsH4MwFrRJO3fP3ALmO4TWxNh84g0rMPEze2RQIBCvmQKpPkVtNGFzlJOuLnoaYqIoRrurekTTrbzVcXgwgQDkVxo5t221p2mLqbTedSfYu+k6HBttROVjE1GBGew=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:25.397767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-47631d6a-ff61-4f2f-85fa-e2954295f87a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:59:25.405853 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-47631d6a-ff61-4f2f-85fa-e2954295f87a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:59:25.436585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-47631d6a-ff61-4f2f-85fa-e2954295f87a tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066409 May 13 12:59:25.445094 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 254/531] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 12:59:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:25.691463 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:25.692050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:25.698766 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:25.699236 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:25.700106 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:25.700541 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:25.725313 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lazy-loading 'flavor' on Instance uuid 6707c346-88db-4146-b776-e3e370c709d5 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 12:59:26.019403 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d6e036b1-018c-4873-947a-3e743de8a529 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/action" status: 202 len: 0 microversion: 2.20 time: 0.331853 May 13 12:59:26.023465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 278/532] 10.222.0.49 () {62 vars in 1318 bytes} [Fri May 13 12:59:25 2022] POST /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 12:59:26.029502 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:26.030192 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:26.038315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:26.038955 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:26.039848 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:26.040305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:26.256282 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:26.257309 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:26.263852 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:26.264783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:26.265606 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:26.266268 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:26.416341 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:26.441699 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:26.443768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:26.446549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-631acf19-9f21-4f31-b3dd-4009749d6cf4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.420814 May 13 12:59:26.447366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 255/533] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:26 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:59:26.458296 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:26.464294 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ecae63e8-7c8d-47a9-a8e3-1fe8c46aae08 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.212866 May 13 12:59:26.466256 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 279/534] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:26 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:59:26.828213 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-1f0d49b0-e591-4595-af14-ffa2d5f8a3c5 req-4df4f3c8-2f20-4550-b570-024b012be274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dc3686-a1be-4e57-8d5a-9d1f94f597d1", "name": "network-vif-plugged", "status": "completed", "tag": "5ac86e19-cc6f-4364-9f1f-30cab19c886a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:26.836808 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-1f0d49b0-e591-4595-af14-ffa2d5f8a3c5 req-4df4f3c8-2f20-4550-b570-024b012be274 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:26.837523 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-1f0d49b0-e591-4595-af14-ffa2d5f8a3c5 req-4df4f3c8-2f20-4550-b570-024b012be274 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:26.850769 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-1f0d49b0-e591-4595-af14-ffa2d5f8a3c5 req-4df4f3c8-2f20-4550-b570-024b012be274 service nova] Creating event network-vif-plugged:5ac86e19-cc6f-4364-9f1f-30cab19c886a for instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 on hv-cinder-84164 May 13 12:59:26.856929 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-1f0d49b0-e591-4595-af14-ffa2d5f8a3c5 req-4df4f3c8-2f20-4550-b570-024b012be274 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032680 May 13 12:59:26.857923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 256/535] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:27.022120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-474501010", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1c41e28-5d16-459f-865e-9320359228db"}], "security_groups": [{"name": "tempest-securitygroup--1026033506"}], "key_name": "tempest-keypair-2067688971", "user_data": "}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:27.166288 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] validate_networks() for [('f1c41e28-5d16-459f-865e-9320359228db', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 12:59:27.466957 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:27.467796 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:27.474441 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:27.474979 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:27.475820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:27.476461 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:27.553425 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 12:59:27.553853 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 12:59:27.554335 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 12:59:27.554751 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 12:59:27.555165 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 12:59:27.564705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:27.565293 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:27.566202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:27.566867 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:27.586481 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 12:59:27.592045 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Getting quotas for user b8c8941361fb4800ad0574237c9ac377 and project 7ec55859792345359fc7b22003b4e995. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 12:59:27.604711 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 12:59:27.607005 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 12:59:27.629515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:27.640605 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:27.642642 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:27.644142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c0e01aad-833e-4add-9e8e-bd35dabbe7b4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.182353 May 13 12:59:27.645056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 257/536] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:27 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:59:27.650034 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:27.650724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:27.658333 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:27.658798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:27.659587 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:27.660180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e602032e-471f-4a77-a412-8ad03a5d297c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.643043 May 13 12:59:27.660481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:27.665899 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 280/537] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 12:59:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 12:59:27.671119 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3cf8934a-7c11-4b1c-b1fc-db51714d32f0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:27.672069 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3cf8934a-7c11-4b1c-b1fc-db51714d32f0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:27.731994 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3cf8934a-7c11-4b1c-b1fc-db51714d32f0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:27.739387 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3cf8934a-7c11-4b1c-b1fc-db51714d32f0 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1241 microversion: 2.1 time: 0.072168 May 13 12:59:27.740162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 281/538] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:27 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:27.817661 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:27.825539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d29d238c-8437-4ef3-9275-7889b9bffde5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1361 microversion: 2.1 time: 0.179133 May 13 12:59:27.826433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 258/539] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:27 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:28.663635 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:28.664245 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:28.673823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:28.673823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:28.674541 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:28.674977 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:28.757155 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:28.757765 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:28.765043 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:28.765722 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:28.766709 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:28.767309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:28.845253 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:28.851958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:28.854798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1cc74f33-b473-4468-862d-cc025326b6f5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1245 microversion: 2.1 time: 0.101431 May 13 12:59:28.855847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 259/540] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:28 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:28.860422 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:28.861049 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:28.867531 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:28.868197 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:28.869084 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:28.869752 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:28.871104 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:28.872964 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:28.874392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-14e57786-72a6-40bb-8e56-77ff2e02f5ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.214632 May 13 12:59:28.874961 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 282/541] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:28 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:29.020751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:29.029251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f48ff9af-3015-4ccf-8943-9bfc471f782c tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1547 microversion: 2.1 time: 0.172318 May 13 12:59:29.029816 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 260/542] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:28 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:29.045951 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8ce1957b-aafb-42bf-a510-181f2a64c6a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:29.046446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8ce1957b-aafb-42bf-a510-181f2a64c6a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:29.052172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ce1957b-aafb-42bf-a510-181f2a64c6a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:29.052618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ce1957b-aafb-42bf-a510-181f2a64c6a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:29.053409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ce1957b-aafb-42bf-a510-181f2a64c6a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:29.053845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ce1957b-aafb-42bf-a510-181f2a64c6a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:29.141701 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8ce1957b-aafb-42bf-a510-181f2a64c6a4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099786 May 13 12:59:29.142489 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 283/543] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:59:29 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:29.870810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:29.872145 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:29.878500 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:29.878946 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:29.879711 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:29.880145 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:29.892720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:29.894003 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:29.900030 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:29.900479 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:29.901270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:29.901865 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:29.992091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:30.001809 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c3e6c4a8-a0ac-4f42-9450-6818eb3c07ec tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1299 microversion: 2.1 time: 0.134752 May 13 12:59:30.002523 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 261/544] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:29 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:30.040345 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:30.049229 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:30.050715 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:30.051934 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a074dc18-0ea5-4850-beed-361aede1364a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.163577 May 13 12:59:30.052440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 284/545] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:29 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:59:30.572218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-431c1320-bd2a-46b8-a4a4-3f89825e0aef req-5c08f6c1-769f-4ef3-bfa3-8d4a8ef6e5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80dc3686-a1be-4e57-8d5a-9d1f94f597d1", "tag": "5ac86e19-cc6f-4364-9f1f-30cab19c886a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:30.581444 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-431c1320-bd2a-46b8-a4a4-3f89825e0aef req-5c08f6c1-769f-4ef3-bfa3-8d4a8ef6e5ba service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:30.581946 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-431c1320-bd2a-46b8-a4a4-3f89825e0aef req-5c08f6c1-769f-4ef3-bfa3-8d4a8ef6e5ba service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:30.594280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-431c1320-bd2a-46b8-a4a4-3f89825e0aef req-5c08f6c1-769f-4ef3-bfa3-8d4a8ef6e5ba service nova] Creating event network-changed:5ac86e19-cc6f-4364-9f1f-30cab19c886a for instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 on hv-cinder-84164 May 13 12:59:30.599748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-431c1320-bd2a-46b8-a4a4-3f89825e0aef req-5c08f6c1-769f-4ef3-bfa3-8d4a8ef6e5ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032837 May 13 12:59:30.600562 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 262/546] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:31.019644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:31.021074 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:31.030029 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:31.030749 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:31.031754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:31.032528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:31.072105 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:31.073623 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:31.081445 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:31.082250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:31.083290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:31.084011 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:31.246873 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:31.254815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b26483e0-6afc-46f8-b218-423195de746e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.238933 May 13 12:59:31.255435 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 285/547] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:31 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:31.403200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:31.412577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:31.414092 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:31.415540 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0c39888a-97f8-41e4-a190-1b68b9d18149 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.348358 May 13 12:59:31.416180 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 263/548] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:31 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:59:32.271575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:32.272196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:32.278832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:32.279282 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:32.280049 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:32.280486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:32.407488 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:32.415070 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f281b807-ef29-4631-9bcb-43e805982d45 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.147319 May 13 12:59:32.415644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 286/549] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:32 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:32.435745 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:32.436367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:32.442745 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:32.443206 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:32.443983 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:32.444429 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:32.575262 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:32.582857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:32.584358 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:32.585560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d149e5e9-82cb-4b76-a5cc-181f787765a1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.154541 May 13 12:59:32.586130 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 264/550] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:32 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:32.616144 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-b0fa5d71-fbb1-4e59-afa4-83260b38f8b7 req-949ddcd5-0436-4f43-acab-5e1a528b4ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b33371a-b63f-4932-a850-1b16b2bbd393", "tag": "63c9af63-3627-4908-ba96-ff2fd8ff4b4a"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:32.624685 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-b0fa5d71-fbb1-4e59-afa4-83260b38f8b7 req-949ddcd5-0436-4f43-acab-5e1a528b4ece service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:32.625090 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-b0fa5d71-fbb1-4e59-afa4-83260b38f8b7 req-949ddcd5-0436-4f43-acab-5e1a528b4ece service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:32.635374 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-b0fa5d71-fbb1-4e59-afa4-83260b38f8b7 req-949ddcd5-0436-4f43-acab-5e1a528b4ece service nova] Creating event network-changed:63c9af63-3627-4908-ba96-ff2fd8ff4b4a for instance 0b33371a-b63f-4932-a850-1b16b2bbd393 on hv-cinder-84164 May 13 12:59:32.640386 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-b0fa5d71-fbb1-4e59-afa4-83260b38f8b7 req-949ddcd5-0436-4f43-acab-5e1a528b4ece service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027846 May 13 12:59:32.640955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 287/551] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:33.431296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:33.431918 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:33.438552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:33.439103 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:33.439767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:33.440212 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:33.566131 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:33.573504 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-143d5b35-7f32-437b-8e13-273c0bc83eed tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.146026 May 13 12:59:33.574079 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 265/552] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:33 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:33.604226 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:33.604930 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:33.611873 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:33.612331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:33.613141 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:33.613580 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:33.739337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:33.748211 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:33.749778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:33.750980 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-73022858-677d-439f-9aa1-e796968a7e52 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.151440 May 13 12:59:33.751549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 288/553] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:33 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:34.590584 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:34.591197 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:34.597493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:34.597940 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:34.598699 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:34.599135 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:34.724563 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:34.732367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c2640f57-6c9c-4d10-9c72-2c04dc182d3e tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.146187 May 13 12:59:34.732950 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 266/554] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:34 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:34.768876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:34.769517 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:34.775833 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:34.776286 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:34.777068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:34.778159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:34.916169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:34.924046 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:34.925638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:34.926739 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fe539277-f0e9-44a9-bb35-b208308f0e59 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.161755 May 13 12:59:34.927303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 289/555] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:34 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:35.749118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:35.750763 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:35.758036 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:35.758490 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:35.759283 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:35.759724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:35.944478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:35.945900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:35.953079 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:35.953556 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:35.954355 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:35.954795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:35.975255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:35.983934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6377ac30-3018-4560-88d8-3e35e634bce5 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.239386 May 13 12:59:35.984711 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 267/556] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:35 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:36.091575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:36.099750 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:36.101370 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:36.102640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b3d3687f-fc3b-4c35-bee7-4c9d679240af tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.162189 May 13 12:59:36.103217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 290/557] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:35 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:59:37.002349 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:37.002970 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:37.009821 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:37.010477 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:37.011272 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:37.012278 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:37.145579 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:37.153525 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a1fea4bc-e094-4e99-b7e4-de98462f9df4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.155309 May 13 12:59:37.154182 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 268/558] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:36 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 12:59:37.287297 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:37.287915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:37.294404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:37.294850 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:37.295645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:37.296316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:37.434323 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:37.442586 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:37.444083 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:37.445264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2a89fb62-d955-455c-af79-647820fbbf65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.327975 May 13 12:59:37.445826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 291/559] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:37 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 12:59:38.170295 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:38.170868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:38.177425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:38.177876 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:38.178649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:38.179088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:38.307118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:38.315270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-80d92fe4-c0e5-4eac-9407-2951a9da2b29 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.148989 May 13 12:59:38.315849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 269/560] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:38 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:38.462993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:38.463612 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:38.469663 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:38.470123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:38.470951 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:38.471347 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:38.604782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:38.613659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:38.615318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:38.616587 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-34496336-369e-4241-8996-1ae5c75073ba tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.157539 May 13 12:59:38.623631 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 292/561] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:38 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:39.332641 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:39.333331 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:39.339375 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:39.340432 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:39.341365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:39.341711 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:39.481204 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:39.488510 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a39c6f38-1a4e-4170-8f03-f6df402ff885 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.159703 May 13 12:59:39.489099 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 270/562] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:39 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:39.641964 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:39.642568 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:39.649219 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:39.649746 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:39.650515 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:39.650953 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:39.782273 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:39.790247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:39.791778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:39.792967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b74ef964-5d5c-4135-8662-216dbb2413c5 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.154959 May 13 12:59:39.793567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 293/563] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:39 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:40.505492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:40.506113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:40.513102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:40.513543 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:40.514318 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:40.514759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:40.654480 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:40.663836 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-bc021c38-f1bd-4fa1-8e32-fe40a5ead840 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.161329 May 13 12:59:40.673870 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 271/564] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:40 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:40.811253 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:40.811905 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:40.818616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:40.819512 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:40.820616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:40.821221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:40.856178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-d101ea18-304d-4635-bc03-3bb6b7cdc122 req-5f5f8c7e-573a-45b2-9e97-ed2afbcf6511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b33371a-b63f-4932-a850-1b16b2bbd393", "name": "network-vif-plugged", "status": "completed", "tag": "63c9af63-3627-4908-ba96-ff2fd8ff4b4a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:40.869033 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-d101ea18-304d-4635-bc03-3bb6b7cdc122 req-5f5f8c7e-573a-45b2-9e97-ed2afbcf6511 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:40.870831 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-d101ea18-304d-4635-bc03-3bb6b7cdc122 req-5f5f8c7e-573a-45b2-9e97-ed2afbcf6511 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:40.884118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-d101ea18-304d-4635-bc03-3bb6b7cdc122 req-5f5f8c7e-573a-45b2-9e97-ed2afbcf6511 service nova] Creating event network-vif-plugged:63c9af63-3627-4908-ba96-ff2fd8ff4b4a for instance 0b33371a-b63f-4932-a850-1b16b2bbd393 on hv-cinder-84164 May 13 12:59:40.892700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-d101ea18-304d-4635-bc03-3bb6b7cdc122 req-5f5f8c7e-573a-45b2-9e97-ed2afbcf6511 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040567 May 13 12:59:40.894575 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 272/565] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:40.969206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:40.979167 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:40.982902 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:40.984780 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-be96dc24-852a-414c-bc17-31c1abedc928 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.177380 May 13 12:59:40.986603 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 294/566] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:40 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:41.682434 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:41.683057 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:41.689294 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:41.689745 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:41.690504 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:41.690939 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:41.816649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:41.823806 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-081b99c0-a5b9-43ac-be0e-b7f527fd030d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1367 microversion: 2.1 time: 0.146098 May 13 12:59:41.825055 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 273/567] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:41 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:42.005267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:42.005883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:42.012882 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:42.013429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:42.014200 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:42.014648 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:42.150807 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:42.159258 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:42.160774 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:42.161974 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1e9a6b2e-9d10-45c3-a7ab-2d1e6ae7c7b7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.160619 May 13 12:59:42.162544 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 295/568] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:42 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:42.842304 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:42.842920 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:42.849300 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:42.849753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:42.850514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:42.851093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:42.982975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:42.990569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-07900eda-b22c-440f-8ba2-5605a1bb8198 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1556 microversion: 2.1 time: 0.153068 May 13 12:59:42.991148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 274/569] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 12:59:42 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 12:59:43.006999 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-803cd5d1-c657-4f58-a16f-997f31180dbb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:43.007504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-803cd5d1-c657-4f58-a16f-997f31180dbb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:43.014376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-803cd5d1-c657-4f58-a16f-997f31180dbb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:43.014831 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-803cd5d1-c657-4f58-a16f-997f31180dbb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:43.015599 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-803cd5d1-c657-4f58-a16f-997f31180dbb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:43.016038 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-803cd5d1-c657-4f58-a16f-997f31180dbb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:43.092683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-803cd5d1-c657-4f58-a16f-997f31180dbb tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089343 May 13 12:59:43.093289 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 296/570] 10.222.0.49 () {58 vars in 1274 bytes} [Fri May 13 12:59:43 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:43.179639 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:43.180518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:43.186376 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:43.186865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:43.187655 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:43.188099 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:43.319284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:43.328568 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:43.330124 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:43.331320 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8adecb95-48d5-4e50-bc0b-a77e35719566 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1745 microversion: 2.20 time: 0.155638 May 13 12:59:43.331925 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 275/571] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:43 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:44.295644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-ffaa9bd5-7e78-4619-8d68-055484371323 req-16439b43-d95f-4557-b71d-c60fc64d288b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b33371a-b63f-4932-a850-1b16b2bbd393", "tag": "63c9af63-3627-4908-ba96-ff2fd8ff4b4a"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:44.304895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-ffaa9bd5-7e78-4619-8d68-055484371323 req-16439b43-d95f-4557-b71d-c60fc64d288b service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:44.305609 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-ffaa9bd5-7e78-4619-8d68-055484371323 req-16439b43-d95f-4557-b71d-c60fc64d288b service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:44.318217 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-ffaa9bd5-7e78-4619-8d68-055484371323 req-16439b43-d95f-4557-b71d-c60fc64d288b service nova] Creating event network-changed:63c9af63-3627-4908-ba96-ff2fd8ff4b4a for instance 0b33371a-b63f-4932-a850-1b16b2bbd393 on hv-cinder-84164 May 13 12:59:44.323720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-ffaa9bd5-7e78-4619-8d68-055484371323 req-16439b43-d95f-4557-b71d-c60fc64d288b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032811 May 13 12:59:44.324368 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 297/572] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:44.350325 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:44.350934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:44.357335 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:44.357785 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:44.358555 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:44.358991 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:44.495778 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:44.504306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:44.506030 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:44.507323 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7d0e096b-0167-4bc6-8231-5a5375699e97 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1745 microversion: 2.20 time: 0.160903 May 13 12:59:44.507896 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 276/573] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:44 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:45.526272 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:45.526991 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:45.534006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:45.534462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:45.535242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:45.535680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:45.674071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:45.682034 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:45.683534 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:45.684745 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8e58fdca-9929-4bf5-a162-9b79e38f90e8 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1745 microversion: 2.20 time: 0.162798 May 13 12:59:45.685365 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 298/574] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:45 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:46.703305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:46.704443 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:46.710704 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:46.711407 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:46.712356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:46.712803 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:46.803385 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-675063b8-c0cc-4d16-ba51-6abbcc30c94f req-ee8e12ac-4742-4155-bde1-c8a24b00bba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6707c346-88db-4146-b776-e3e370c709d5", "name": "network-vif-plugged", "status": "completed", "tag": "2e9af4d2-bc43-4cbb-989c-99de3b22e35f"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 12:59:46.815682 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-675063b8-c0cc-4d16-ba51-6abbcc30c94f req-ee8e12ac-4742-4155-bde1-c8a24b00bba6 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:46.816818 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-675063b8-c0cc-4d16-ba51-6abbcc30c94f req-ee8e12ac-4742-4155-bde1-c8a24b00bba6 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:46.834681 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-675063b8-c0cc-4d16-ba51-6abbcc30c94f req-ee8e12ac-4742-4155-bde1-c8a24b00bba6 service nova] Creating event network-vif-plugged:2e9af4d2-bc43-4cbb-989c-99de3b22e35f for instance 6707c346-88db-4146-b776-e3e370c709d5 on hv-cinder-84164 May 13 12:59:46.841613 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-675063b8-c0cc-4d16-ba51-6abbcc30c94f req-ee8e12ac-4742-4155-bde1-c8a24b00bba6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043325 May 13 12:59:46.842754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 299/575] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 12:59:46.914385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:46.922619 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:46.924302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:46.925574 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7a85255d-6dc4-4c91-80f7-7f57314fe2a7 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.226702 May 13 12:59:46.926211 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 277/576] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:46 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:47.946443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:47.950112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:47.960787 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:47.961383 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:47.962247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:47.962757 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:48.147082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:48.156713 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:48.158680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:48.159953 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e2a0a129-cf24-4be0-a6ac-a6c8ae53cb6b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.219971 May 13 12:59:48.160779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 300/577] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:47 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:49.179804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:49.180692 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:49.187835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:49.188423 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:49.189236 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:49.189675 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:49.335958 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:49.345969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:49.347470 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:49.348857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-df46b577-ccdc-40c5-9266-ffef463cc8d6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.173331 May 13 12:59:49.359636 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 278/578] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:49 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:50.367827 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:50.369126 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:50.375781 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:50.376438 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:50.377395 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:50.378014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:50.526283 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:50.535408 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:50.536834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:50.538037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-acfdf65c-75dd-460e-93ed-82bbc237f316 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.174415 May 13 12:59:50.538599 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 301/579] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:50 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:51.556881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:51.558493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:51.567341 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:51.567999 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:51.569006 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:51.569649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:51.726131 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:51.738879 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:51.740485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:51.741955 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fd7b13fb-faf2-4511-a143-a4005beb7955 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.188897 May 13 12:59:51.742714 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 279/580] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:51 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:52.761038 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:52.763386 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:52.771513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:52.772111 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:52.773048 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:52.773582 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:52.958935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:52.969590 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:52.971475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:52.972862 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-31b76868-7905-425e-a96d-bb2cfa689eb6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.215636 May 13 12:59:52.973810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 302/581] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:52 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:53.992734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:53.994117 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:54.001616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:54.002071 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:54.002845 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:54.003283 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:54.153559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:54.162081 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:54.163638 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:54.165718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7d42a3cf-2b5a-4b5f-991e-55f0eacd7c6f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.177894 May 13 12:59:54.166919 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 280/582] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:53 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:55.184463 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:55.185171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:55.192055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:55.192510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:55.193305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:55.196059 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:55.345111 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:55.353440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:55.355032 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:55.357037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0398fd9a-0ecc-4ebf-b8b4-b6c1031e6a37 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1740 microversion: 2.20 time: 0.176467 May 13 12:59:55.357704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 303/583] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:55 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:56.374289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:56.375008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:56.381329 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:56.381789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:56.382570 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:56.383009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:56.584314 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:56.594240 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:56.596170 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:56.597569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6a442776-77e0-4fb0-94a4-67411bf6dd28 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1722 microversion: 2.20 time: 0.227232 May 13 12:59:56.598706 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 281/584] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:56 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:57.615598 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:57.616206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:57.623258 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:57.623700 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:57.624456 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:57.624891 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:57.756494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:57.765643 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:57.767342 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:57.768519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0350f586-ea45-450d-b498-83324c86085c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1722 microversion: 2.20 time: 0.156815 May 13 12:59:57.769194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 304/585] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:57 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:58.787026 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:58.787623 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:58.793593 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:58.794042 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:58.794813 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:58.795251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:58.926296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:58.934680 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:58.936194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 12:59:58.937392 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-40c5a6e2-b79b-499c-9369-c47ef4d35f4e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1722 microversion: 2.20 time: 0.154455 May 13 12:59:58.937951 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 282/586] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:58 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 12:59:59.956784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 12:59:59.958161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 12:59:59.965701 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:59.966362 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 12:59:59.967164 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 12:59:59.967609 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:00.006458 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-21c92720-5cac-4713-9fb2-9124cfce8633 req-f731801f-ab03-4d13-9bfe-96b6eea61516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6707c346-88db-4146-b776-e3e370c709d5", "name": "network-vif-unplugged", "status": "completed", "tag": "2e9af4d2-bc43-4cbb-989c-99de3b22e35f"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:00.014487 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-21c92720-5cac-4713-9fb2-9124cfce8633 req-f731801f-ab03-4d13-9bfe-96b6eea61516 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:00.015012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-21c92720-5cac-4713-9fb2-9124cfce8633 req-f731801f-ab03-4d13-9bfe-96b6eea61516 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:00.025918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-21c92720-5cac-4713-9fb2-9124cfce8633 req-f731801f-ab03-4d13-9bfe-96b6eea61516 service nova] Creating event network-vif-unplugged:2e9af4d2-bc43-4cbb-989c-99de3b22e35f for instance 6707c346-88db-4146-b776-e3e370c709d5 on hv-cinder-84164 May 13 13:00:00.031634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-21c92720-5cac-4713-9fb2-9124cfce8633 req-f731801f-ab03-4d13-9bfe-96b6eea61516 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150227 May 13 13:00:00.032342 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 305/587] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 12:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:00.096625 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:00.104415 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:00.106169 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:00.107352 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5a40b01e-d381-48da-b757-d73969039f8f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1722 microversion: 2.20 time: 0.155989 May 13 13:00:00.107919 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 283/588] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 12:59:59 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:00:01.127338 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:01.128036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:01.134634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.135089 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:01.135874 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.136314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:01.272842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:01.281328 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:01.282822 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:01.284222 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-525b1e6f-5bb3-4427-97fd-5ff2d8430e65 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1725 microversion: 2.20 time: 0.162270 May 13 13:00:01.284786 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 306/589] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:01 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:01.302304 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3dc92c85-c998-45ce-8801-bbceac703e80 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15308daf-598f-401c-9bcd-a3df53314877"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:01.303378 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3dc92c85-c998-45ce-8801-bbceac703e80 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:01.310846 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3dc92c85-c998-45ce-8801-bbceac703e80 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.311302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3dc92c85-c998-45ce-8801-bbceac703e80 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:01.312077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3dc92c85-c998-45ce-8801-bbceac703e80 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.312522 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3dc92c85-c998-45ce-8801-bbceac703e80 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:01.566824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3dc92c85-c998-45ce-8801-bbceac703e80 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.268471 May 13 13:00:01.567449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 284/590] 10.222.0.49 () {62 vars in 1363 bytes} [Fri May 13 13:00:01 2022] POST /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-volume_attachments => generated 188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:00:01.678008 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1c039912-0f84-4680-996a-177841b3b1fa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:01.678504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1c039912-0f84-4680-996a-177841b3b1fa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:01.684354 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1c039912-0f84-4680-996a-177841b3b1fa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.684797 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1c039912-0f84-4680-996a-177841b3b1fa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:01.685581 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1c039912-0f84-4680-996a-177841b3b1fa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.686012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1c039912-0f84-4680-996a-177841b3b1fa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:01.920274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1c039912-0f84-4680-996a-177841b3b1fa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-volume_attachments/15308daf-598f-401c-9bcd-a3df53314877" status: 202 len: 0 microversion: 2.20 time: 0.246240 May 13 13:00:01.920870 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 307/591] 10.222.0.49 () {60 vars in 1456 bytes} [Fri May 13 13:00:01 2022] DELETE /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-volume_attachments/15308daf-598f-401c-9bcd-a3df53314877 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:00:01.974561 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1e393444-4121-4018-8231-ee42ff0ec23b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:01.975137 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1e393444-4121-4018-8231-ee42ff0ec23b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:01.981200 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e393444-4121-4018-8231-ee42ff0ec23b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.981651 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e393444-4121-4018-8231-ee42ff0ec23b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:01.982423 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e393444-4121-4018-8231-ee42ff0ec23b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:01.982861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e393444-4121-4018-8231-ee42ff0ec23b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:02.170351 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1e393444-4121-4018-8231-ee42ff0ec23b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "POST /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/action" status: 202 len: 0 microversion: 2.20 time: 0.199481 May 13 13:00:02.171185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 285/592] 10.222.0.49 () {62 vars in 1318 bytes} [Fri May 13 13:00:01 2022] POST /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:00:02.179572 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:02.180442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:02.187908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:02.188460 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:02.189307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:02.189808 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:02.329912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:02.338312 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:02.340352 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:02.341599 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-be590a68-190d-4591-94b2-2b19f983564a tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1673 microversion: 2.20 time: 0.165848 May 13 13:00:02.342202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 308/593] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:02 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:00:03.360412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:03.360950 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:03.367646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:03.368317 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:03.369396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:03.369926 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:03.513816 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:03.521679 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:03.523189 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:03.524356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-515779a1-6647-44a2-adca-02e7a252dc0e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.168632 May 13 13:00:03.524920 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 286/594] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:03 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:04.544331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:04.544943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:04.551261 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:04.551712 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:04.552479 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:04.552917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:04.684751 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:04.692600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:04.694169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:04.695311 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8ca16920-0a53-45b9-a85b-d13f8a4963e6 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.155638 May 13 13:00:04.695875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 309/595] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:04 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:05.713575 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:05.714109 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:05.720753 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:05.721244 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:05.722012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:05.722455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:05.852519 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:05.860944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:05.862460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:05.863624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9f09a5b3-4840-414d-a3b2-c006a8c6b6b1 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.154058 May 13 13:00:05.864195 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 287/596] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:05 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:06.881809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:06.882425 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:06.889416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:06.889872 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:06.890646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:06.891086 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:07.084242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:07.099857 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:07.103695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:07.106450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-54f6bf43-c2a6-400a-a54c-9ebf48541f72 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.228169 May 13 13:00:07.107195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 310/597] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:06 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:08.125558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:08.126289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:08.132751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:08.133576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:08.134363 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:08.134853 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:08.272916 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:08.290671 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:08.292218 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:08.294302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3a476b70-8a26-42cd-89ff-ccd2a34d5164 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.173247 May 13 13:00:08.305096 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 288/598] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:08 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:09.313306 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:09.313929 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:09.320198 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:09.320657 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:09.321466 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:09.321910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:09.464292 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:09.473988 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:09.476288 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:09.478360 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c72c3756-d069-4540-899d-71f1889c78bc tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.169963 May 13 13:00:09.490100 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 311/599] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:09 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:10.498755 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:10.499615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:10.505280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:10.505732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:10.506768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:10.507209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:10.667332 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:10.676759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:10.678542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:10.680037 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-05d16f5e-a3a7-46ee-a457-2dc0207ab875 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.185924 May 13 13:00:10.680727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 289/600] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:10 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:00:11.700056 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:11.700943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:11.707363 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:11.707824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:11.708609 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:11.709079 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:11.915283 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:11.923738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:11.925716 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:11.927061 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ef395d3b-2cf8-4212-83f2-7323da4a2d90 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.231203 May 13 13:00:11.940561 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 312/601] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:11 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:12.954187 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:12.959417 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:12.973667 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:12.974426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:12.975390 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:12.977536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:13.138722 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:13.158298 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:13.160073 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:13.161271 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-65ba42be-f3a5-4c03-9165-6e7e31e0ff7c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.211069 May 13 13:00:13.161836 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 290/602] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:12 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:14.179776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:14.181135 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:14.189552 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:14.190269 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:14.191224 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:14.191828 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:14.370084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:14.379650 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:14.381198 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:14.382375 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-545513ba-a12c-4078-bbbf-a222fe2d7d07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.206488 May 13 13:00:14.382983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 313/603] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:14 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:15.401771 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:15.402940 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:15.409739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:15.410198 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:15.410981 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:15.411423 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:15.560405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:15.568186 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:15.569888 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:15.571236 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5ac54276-3b1f-41df-9f00-634911fa1788 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.173301 May 13 13:00:15.572058 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 291/604] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:15 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:16.590595 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:16.591401 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:16.597996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:16.598529 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:16.599367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:16.599876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:16.739939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:16.748947 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:16.750618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:16.751875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1cc7bae9-9984-4243-98f7-1c5c635d1901 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.165819 May 13 13:00:16.752521 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 314/605] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:16 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:17.761005 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1e950881-5f5b-43ea-a6cb-c0afccdab725 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:17.761512 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1e950881-5f5b-43ea-a6cb-c0afccdab725 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:17.769585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e950881-5f5b-43ea-a6cb-c0afccdab725 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:17.770025 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e950881-5f5b-43ea-a6cb-c0afccdab725 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:17.770923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e950881-5f5b-43ea-a6cb-c0afccdab725 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:17.771368 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e950881-5f5b-43ea-a6cb-c0afccdab725 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:17.772028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:17.772870 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:17.782522 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:17.782979 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:17.784058 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:17.784618 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:17.801047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1e950881-5f5b-43ea-a6cb-c0afccdab725 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/ips" status: 200 len: 146 microversion: 2.1 time: 0.043405 May 13 13:00:17.801823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 292/606] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 13:00:17 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:17.947266 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:17.958577 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:17.960417 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:17.961645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d8187b68-1633-4c62-94a5-e7914bf92a24 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.195438 May 13 13:00:17.964076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 315/607] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:17 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:18.989184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:18.990439 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:18.998395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:18.998962 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:19.000022 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:19.000390 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:19.139502 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:19.147702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:19.149302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:19.150621 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6d1da056-d6e3-4152-9541-dfe3e5871914 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.165306 May 13 13:00:19.151285 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 293/608] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:18 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:19.182080 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-23f3521b-835b-443d-882a-acb9a5681046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a79c6226-bc34-49a3-8451-553e67c2fcfc"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:19.183202 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-23f3521b-835b-443d-882a-acb9a5681046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:19.189690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23f3521b-835b-443d-882a-acb9a5681046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:19.190210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23f3521b-835b-443d-882a-acb9a5681046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:19.191096 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23f3521b-835b-443d-882a-acb9a5681046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:19.191576 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23f3521b-835b-443d-882a-acb9a5681046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:19.474287 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-23f3521b-835b-443d-882a-acb9a5681046 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295606 May 13 13:00:19.475162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 316/609] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 13:00:19 2022] POST /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:00:20.170636 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:20.171258 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:20.177749 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:20.178225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:20.179046 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:20.179494 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:20.630260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:20.654229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:20.663347 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:20.665907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2cb128c9-4e6d-4b8c-ae89-2452c0a3ccab tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.499140 May 13 13:00:20.666831 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 294/610] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:20 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:00:21.006590 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-6b0f81ae-f7e7-404e-91c5-01aefb15872d req-b7b6abff-fc55-4edb-99a4-81aaf0c2dcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6707c346-88db-4146-b776-e3e370c709d5", "name": "network-vif-plugged", "status": "completed", "tag": "2e9af4d2-bc43-4cbb-989c-99de3b22e35f"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:21.016694 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-6b0f81ae-f7e7-404e-91c5-01aefb15872d req-b7b6abff-fc55-4edb-99a4-81aaf0c2dcd7 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:21.017245 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-6b0f81ae-f7e7-404e-91c5-01aefb15872d req-b7b6abff-fc55-4edb-99a4-81aaf0c2dcd7 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:21.029411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-6b0f81ae-f7e7-404e-91c5-01aefb15872d req-b7b6abff-fc55-4edb-99a4-81aaf0c2dcd7 service nova] Creating event network-vif-plugged:2e9af4d2-bc43-4cbb-989c-99de3b22e35f for instance 6707c346-88db-4146-b776-e3e370c709d5 on hv-cinder-84164 May 13 13:00:21.034822 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-6b0f81ae-f7e7-404e-91c5-01aefb15872d req-b7b6abff-fc55-4edb-99a4-81aaf0c2dcd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 May 13 13:00:21.035941 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 317/611] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:21.684621 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:21.685449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:21.691372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:21.691825 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:21.692593 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:21.693130 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:21.825088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:21.834460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:21.835980 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:21.837194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d7f375cc-b58b-4877-aa82-1beb2e6139c4 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.156377 May 13 13:00:21.837767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 295/612] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:21 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:22.860699 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:22.861509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:22.880006 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:22.880556 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:22.881379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:22.882188 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:23.025036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:23.033897 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:23.035787 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:23.037107 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-db611850-3b9b-4e52-9db3-0e423cc1f067 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1731 microversion: 2.20 time: 0.184010 May 13 13:00:23.037811 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 318/613] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:22 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:24.056574 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:24.057220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:24.064702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:24.065526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:24.066334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:24.066769 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:24.206144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:24.214428 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:24.216170 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:24.218627 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-19d95cb9-1c71-46b0-97f9-23128002924b tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1718 microversion: 2.20 time: 0.165889 May 13 13:00:24.219093 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 296/614] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:00:24 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:00:27.071889 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-dd90f5ce-b5a0-4c4d-915f-d1b3c3634cf5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:27.072927 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-dd90f5ce-b5a0-4c4d-915f-d1b3c3634cf5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:27.080213 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dd90f5ce-b5a0-4c4d-915f-d1b3c3634cf5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:27.080669 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dd90f5ce-b5a0-4c4d-915f-d1b3c3634cf5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:27.081494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dd90f5ce-b5a0-4c4d-915f-d1b3c3634cf5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:27.081946 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dd90f5ce-b5a0-4c4d-915f-d1b3c3634cf5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:27.112514 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-dd90f5ce-b5a0-4c4d-915f-d1b3c3634cf5 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 May 13 13:00:27.113131 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 319/615] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:00:27 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:00:27.122895 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-494e301f-11ac-43a2-b44b-2510ce61642e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:27.124196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-494e301f-11ac-43a2-b44b-2510ce61642e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:27.130595 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-494e301f-11ac-43a2-b44b-2510ce61642e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:27.131050 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-494e301f-11ac-43a2-b44b-2510ce61642e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:27.131822 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-494e301f-11ac-43a2-b44b-2510ce61642e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:27.132262 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-494e301f-11ac-43a2-b44b-2510ce61642e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:27.160404 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-494e301f-11ac-43a2-b44b-2510ce61642e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/a79c6226-bc34-49a3-8451-553e67c2fcfc" status: 200 len: 194 microversion: 2.1 time: 0.041383 May 13 13:00:27.161017 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 297/616] 10.222.0.49 () {58 vars in 1412 bytes} [Fri May 13 13:00:27 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/a79c6226-bc34-49a3-8451-553e67c2fcfc => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:28.149385 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-65b4779d-8ea6-4f9a-93f6-33f81c4040bf tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:28.149900 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-65b4779d-8ea6-4f9a-93f6-33f81c4040bf tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:28.157400 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65b4779d-8ea6-4f9a-93f6-33f81c4040bf tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:28.157856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65b4779d-8ea6-4f9a-93f6-33f81c4040bf tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:28.158822 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65b4779d-8ea6-4f9a-93f6-33f81c4040bf tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:28.159262 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-65b4779d-8ea6-4f9a-93f6-33f81c4040bf tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:28.183354 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-65b4779d-8ea6-4f9a-93f6-33f81c4040bf tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/ips" status: 200 len: 147 microversion: 2.1 time: 0.227467 May 13 13:00:28.183937 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 320/617] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 13:00:27 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/ips => generated 147 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:28.502934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4fcc1e12-a137-40a2-8eac-5b7012a35589 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f48b818d-98b6-4314-9983-2d2cdce475b8"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:28.504773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4fcc1e12-a137-40a2-8eac-5b7012a35589 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:28.522078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4fcc1e12-a137-40a2-8eac-5b7012a35589 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:28.522078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4fcc1e12-a137-40a2-8eac-5b7012a35589 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:28.522078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4fcc1e12-a137-40a2-8eac-5b7012a35589 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:28.522353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4fcc1e12-a137-40a2-8eac-5b7012a35589 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:28.816716 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4fcc1e12-a137-40a2-8eac-5b7012a35589 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "POST /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318658 May 13 13:00:28.822631 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 298/618] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 13:00:28 2022] POST /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:29.548819 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ae70081d-224e-4a5b-97a3-9fb993f8a177 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "104fc628-5a42-4cb6-a667-81f11da5e5f8"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:29.550815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ae70081d-224e-4a5b-97a3-9fb993f8a177 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:29.557372 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae70081d-224e-4a5b-97a3-9fb993f8a177 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:29.557894 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae70081d-224e-4a5b-97a3-9fb993f8a177 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:29.558764 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae70081d-224e-4a5b-97a3-9fb993f8a177 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:29.559341 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae70081d-224e-4a5b-97a3-9fb993f8a177 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:29.810785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ae70081d-224e-4a5b-97a3-9fb993f8a177 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "POST /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265747 May 13 13:00:29.817977 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 321/619] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 13:00:29 2022] POST /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:30.052408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-178314938", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "networks": [{"uuid": "9adf0a94-4216-4043-b976-598165f0772b"}]}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:30.103634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] validate_networks() for [('9adf0a94-4216-4043-b976-598165f0772b', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:00:30.431078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:00:30.431510 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:00:30.431990 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:00:30.432402 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:00:30.432815 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:00:30.442025 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:30.442479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:30.443284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:30.443725 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:30.460998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Getting quotas for project 6e44eda8115b487cbc52d99ea0634686. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:00:30.464881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Getting quotas for user c6a8a68cdea9415081cfd2a93e701cb8 and project 6e44eda8115b487cbc52d99ea0634686. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:00:30.475571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:00:30.477964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:00:30.522532 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-998ec518-a600-46aa-b502-9a4d05000a8f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474220 May 13 13:00:30.523181 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 299/620] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:00:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:00:30.534009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a2f47c46-c508-43bf-a467-2f0ad031a209 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:30.534969 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a2f47c46-c508-43bf-a467-2f0ad031a209 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:30.589261 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a2f47c46-c508-43bf-a467-2f0ad031a209 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:30.596422 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a2f47c46-c508-43bf-a467-2f0ad031a209 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1213 microversion: 2.1 time: 0.067161 May 13 13:00:30.597024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 322/621] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:30 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:31.614584 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:31.615238 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:31.623144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:31.623609 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:31.624965 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:31.626087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:31.703698 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:31.711492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-84683c24-6478-489b-ba5d-fb90a4d2d82c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1273 microversion: 2.1 time: 0.101378 May 13 13:00:31.712254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 300/622] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:31 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:32.729665 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:32.730318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:32.738033 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:32.738484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:32.739264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:32.739696 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:32.873836 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:32.883860 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-147b889b-0d5b-4faf-8ced-b04fbe3133f1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1313 microversion: 2.1 time: 0.157997 May 13 13:00:32.884773 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 323/623] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:32 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:33.007294 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-287dd2ec-47a9-4f1f-b265-5814224e826d req-80a2c835-9892-4417-bd40-bcb102a2edc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba587519-fd74-4b13-9cdc-ae45275cdafa", "tag": "f16027b6-4411-4969-aa2c-057295bbd0e9"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:33.016110 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-287dd2ec-47a9-4f1f-b265-5814224e826d req-80a2c835-9892-4417-bd40-bcb102a2edc4 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:33.016910 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-287dd2ec-47a9-4f1f-b265-5814224e826d req-80a2c835-9892-4417-bd40-bcb102a2edc4 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:33.028340 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-287dd2ec-47a9-4f1f-b265-5814224e826d req-80a2c835-9892-4417-bd40-bcb102a2edc4 service nova] Creating event network-changed:f16027b6-4411-4969-aa2c-057295bbd0e9 for instance ba587519-fd74-4b13-9cdc-ae45275cdafa on hv-cinder-84164 May 13 13:00:33.033930 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-287dd2ec-47a9-4f1f-b265-5814224e826d req-80a2c835-9892-4417-bd40-bcb102a2edc4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098844 May 13 13:00:33.034525 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 301/624] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:33.902110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:33.902758 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:33.910081 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:33.910538 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:33.911310 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:33.911752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:34.042243 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:34.050160 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e9e30944-6b81-430c-ae98-3a376943b2a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1313 microversion: 2.1 time: 0.151743 May 13 13:00:34.050601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 324/625] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:33 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:35.067936 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:35.068676 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:35.074845 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:35.075299 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:35.076071 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:35.076513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:35.207184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:35.214525 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fe7cca82-3264-414e-a377-54ac0ad0d292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1313 microversion: 2.1 time: 0.151253 May 13 13:00:35.215211 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 302/626] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:35 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:36.231795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:36.232420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:36.239416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.239928 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.240762 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.241313 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.300430 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-78084421-6357-4ce5-843d-70e07942e3bd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:36.301432 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-78084421-6357-4ce5-843d-70e07942e3bd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:36.307801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-78084421-6357-4ce5-843d-70e07942e3bd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.308217 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-78084421-6357-4ce5-843d-70e07942e3bd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.308994 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-78084421-6357-4ce5-843d-70e07942e3bd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.309447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-78084421-6357-4ce5-843d-70e07942e3bd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.339038 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-78084421-6357-4ce5-843d-70e07942e3bd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043146 May 13 13:00:36.339608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 303/627] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:00:36 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:00:36.370822 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:36.378497 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6ebbd818-fc77-46d0-bb71-aacfe5ca6eee tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1313 microversion: 2.1 time: 0.150546 May 13 13:00:36.379009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 325/628] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:36 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:36.482273 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b432b81e-0795-41ce-8f6e-7723f72dbb01 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:36.482734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b432b81e-0795-41ce-8f6e-7723f72dbb01 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:36.489379 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b432b81e-0795-41ce-8f6e-7723f72dbb01 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.489833 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b432b81e-0795-41ce-8f6e-7723f72dbb01 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.490602 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b432b81e-0795-41ce-8f6e-7723f72dbb01 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.491040 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b432b81e-0795-41ce-8f6e-7723f72dbb01 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.521137 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b432b81e-0795-41ce-8f6e-7723f72dbb01 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/a79c6226-bc34-49a3-8451-553e67c2fcfc" status: 200 len: 194 microversion: 2.1 time: 0.042799 May 13 13:00:36.521720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 304/629] 10.222.0.49 () {58 vars in 1412 bytes} [Fri May 13 13:00:36 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/a79c6226-bc34-49a3-8451-553e67c2fcfc => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:36.532161 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:36.532662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:36.539041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.539714 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.540908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:36.541604 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:36.623009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lazy-loading 'services' on Instance uuid 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:00:36.695195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e265c5b6-4b39-435a-a7e9-22a9547f75f7 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/a79c6226-bc34-49a3-8451-553e67c2fcfc" status: 202 len: 0 microversion: 2.1 time: 0.167605 May 13 13:00:36.695788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 326/630] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 13:00:36 2022] DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/a79c6226-bc34-49a3-8451-553e67c2fcfc => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:00:37.395280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:37.395901 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:37.402220 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:37.402674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:37.403447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:37.403891 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:37.530338 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:37.538159 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c00b7859-b585-4cc7-a33e-53db5de7c44c tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1313 microversion: 2.1 time: 0.146748 May 13 13:00:37.538747 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 305/631] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:37 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:38.556455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:38.557165 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:38.564084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:38.564531 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:38.565357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:38.565796 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:38.697037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:38.704842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a52d31a7-4cb9-4b7f-94c1-1a30de5d7aa4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1313 microversion: 2.1 time: 0.153121 May 13 13:00:38.705443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 327/632] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:38 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:39.082617 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-8b8930e5-e8d9-40c7-aad2-3abf6710423b req-b2219a86-9d0b-43ad-bb06-ab1c6587b758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba587519-fd74-4b13-9cdc-ae45275cdafa", "name": "network-vif-plugged", "status": "completed", "tag": "f16027b6-4411-4969-aa2c-057295bbd0e9"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:39.090985 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-8b8930e5-e8d9-40c7-aad2-3abf6710423b req-b2219a86-9d0b-43ad-bb06-ab1c6587b758 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:39.091552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-8b8930e5-e8d9-40c7-aad2-3abf6710423b req-b2219a86-9d0b-43ad-bb06-ab1c6587b758 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:39.104402 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-8b8930e5-e8d9-40c7-aad2-3abf6710423b req-b2219a86-9d0b-43ad-bb06-ab1c6587b758 service nova] Creating event network-vif-plugged:f16027b6-4411-4969-aa2c-057295bbd0e9 for instance ba587519-fd74-4b13-9cdc-ae45275cdafa on hv-cinder-84164 May 13 13:00:39.109650 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-8b8930e5-e8d9-40c7-aad2-3abf6710423b req-b2219a86-9d0b-43ad-bb06-ab1c6587b758 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030248 May 13 13:00:39.110251 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 306/633] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:39.722425 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:39.723043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:39.729399 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:39.729847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:39.730613 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:39.731051 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:39.856073 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:39.863849 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1b81f1ba-68b9-4278-a203-2c4942eea4d4 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1313 microversion: 2.1 time: 0.146181 May 13 13:00:39.864424 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 328/634] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:39 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:40.882162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:40.882868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:40.889052 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:40.889503 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:40.890905 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:40.891455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:41.019445 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:41.027281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-53c4da81-3aba-4865-8c21-d483ea7c1a42 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1496 microversion: 2.1 time: 0.149745 May 13 13:00:41.027855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 307/635] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:40 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:41.530193 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:41.531220 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:41.537992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:41.538494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:41.539269 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:41.539875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:41.566892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:00:41.639752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e99bbf61-c956-4c73-853c-90f8741c1d13 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 204 len: 0 microversion: 2.1 time: 0.113206 May 13 13:00:41.641278 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 329/636] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:41 2022] DELETE /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:00:41.649396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:41.650011 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:41.656368 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:41.656870 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:41.657621 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:41.658064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:41.785474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:41.792799 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d2f938d0-c819-428a-94a5-f41793f10561 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1502 microversion: 2.1 time: 0.147306 May 13 13:00:41.793411 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 308/637] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:41 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:42.812735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:42.813421 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:42.819782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:42.820235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:42.821031 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:42.821474 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:42.958690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:42.966168 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b71b071f-d471-456b-a166-4dd35a5cd36e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1502 microversion: 2.1 time: 0.157911 May 13 13:00:42.966757 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 330/638] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:42 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:43.982879 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:43.983493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:43.990780 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:43.992257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:43.993296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:43.994070 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:44.174387 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:44.182881 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9f49ad38-1a5c-4085-8add-e8a264877be5 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1502 microversion: 2.1 time: 0.203732 May 13 13:00:44.183839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 309/639] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:43 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:44.389757 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-0bd3324a-2678-43cd-a7e9-515bb342c8ce req-46e94030-cd03-42b2-8f85-6c6b4ecba300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba587519-fd74-4b13-9cdc-ae45275cdafa", "name": "network-vif-deleted", "tag": "f16027b6-4411-4969-aa2c-057295bbd0e9"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:44.401184 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-0bd3324a-2678-43cd-a7e9-515bb342c8ce req-46e94030-cd03-42b2-8f85-6c6b4ecba300 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:44.401629 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-0bd3324a-2678-43cd-a7e9-515bb342c8ce req-46e94030-cd03-42b2-8f85-6c6b4ecba300 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:44.414021 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-0bd3324a-2678-43cd-a7e9-515bb342c8ce req-46e94030-cd03-42b2-8f85-6c6b4ecba300 service nova] Creating event network-vif-deleted:f16027b6-4411-4969-aa2c-057295bbd0e9 for instance ba587519-fd74-4b13-9cdc-ae45275cdafa on hv-cinder-84164 May 13 13:00:44.419337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-0bd3324a-2678-43cd-a7e9-515bb342c8ce req-46e94030-cd03-42b2-8f85-6c6b4ecba300 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033411 May 13 13:00:44.419899 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 331/640] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:44.737610 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:44.738113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:44.744169 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:44.744633 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:44.745477 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:44.745927 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:44.826952 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lazy-loading 'services' on Instance uuid 0b33371a-b63f-4932-a850-1b16b2bbd393 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:00:44.911195 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-bc831094-4aaa-4938-a9cd-87af7ce7d6b4 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments/104fc628-5a42-4cb6-a667-81f11da5e5f8" status: 202 len: 0 microversion: 2.1 time: 0.178099 May 13 13:00:44.911791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 310/641] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 13:00:44 2022] DELETE /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments/104fc628-5a42-4cb6-a667-81f11da5e5f8 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:00:44.920794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5cf45188-936b-4862-8c5f-c287847ace88 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:44.922451 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5cf45188-936b-4862-8c5f-c287847ace88 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:44.928773 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5cf45188-936b-4862-8c5f-c287847ace88 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:44.929354 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5cf45188-936b-4862-8c5f-c287847ace88 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:44.930152 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5cf45188-936b-4862-8c5f-c287847ace88 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:44.930588 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5cf45188-936b-4862-8c5f-c287847ace88 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:44.959844 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5cf45188-936b-4862-8c5f-c287847ace88 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043373 May 13 13:00:44.960410 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 332/642] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:00:44 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:45.200802 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:45.201549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:45.208403 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.208856 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.209865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.210305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.241677 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.242328 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.243087 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lazy-loading 'fault' on Instance uuid ba587519-fd74-4b13-9cdc-ae45275cdafa {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:00:45.288037 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:45.291153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2450d339-56d1-46b7-b71b-0f5a76d828ae tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:45.291722 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2450d339-56d1-46b7-b71b-0f5a76d828ae tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:45.295773 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8443f609-97a4-41d4-beee-ffadb5830b3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 200 len: 1303 microversion: 2.1 time: 0.099804 May 13 13:00:45.296378 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 311/643] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:45 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:45.298707 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2450d339-56d1-46b7-b71b-0f5a76d828ae tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.299230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2450d339-56d1-46b7-b71b-0f5a76d828ae tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.300075 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2450d339-56d1-46b7-b71b-0f5a76d828ae tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.300668 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2450d339-56d1-46b7-b71b-0f5a76d828ae tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.332337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2450d339-56d1-46b7-b71b-0f5a76d828ae tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/f48b818d-98b6-4314-9983-2d2cdce475b8" status: 200 len: 194 microversion: 2.1 time: 0.045333 May 13 13:00:45.332960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 333/644] 10.222.0.49 () {58 vars in 1412 bytes} [Fri May 13 13:00:45 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/f48b818d-98b6-4314-9983-2d2cdce475b8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:45.342998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:45.343835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:45.350170 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.350619 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.351492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.351936 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.428709 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lazy-loading 'services' on Instance uuid 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:00:45.497257 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b9e0ce68-ac18-4264-829a-b76ca2a47662 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/f48b818d-98b6-4314-9983-2d2cdce475b8" status: 202 len: 0 microversion: 2.1 time: 0.157952 May 13 13:00:45.497857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 312/645] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 13:00:45 2022] DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments/f48b818d-98b6-4314-9983-2d2cdce475b8 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:00:45.972437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cf437abf-d2b3-40f3-b408-abd059ef1326 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:45.973476 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-cf437abf-d2b3-40f3-b408-abd059ef1326 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:45.980019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cf437abf-d2b3-40f3-b408-abd059ef1326 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.980550 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cf437abf-d2b3-40f3-b408-abd059ef1326 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:45.981525 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cf437abf-d2b3-40f3-b408-abd059ef1326 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:45.982041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cf437abf-d2b3-40f3-b408-abd059ef1326 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:46.012611 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-cf437abf-d2b3-40f3-b408-abd059ef1326 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 May 13 13:00:46.013220 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 334/646] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:00:45 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:46.314075 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:46.314711 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: ba587519-fd74-4b13-9cdc-ae45275cdafa] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:46.320882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:46.321378 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:46.322149 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:46.322591 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:46.337324 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] HTTP exception thrown: Instance ba587519-fd74-4b13-9cdc-ae45275cdafa could not be found. May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Request method failure captured: May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa HTTP/1.1 May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflZsTPpFQEUcCRa8SwYkGU6dfriNI7SsIHxucg8FE8PSHOtLxTy94-bvN6lYXwUSkZ5lEdXXiwG0uBJqqGSKbcw4xkrduZf6I5M_j97_DheFzJpwD3-BCEAFp3_9pKmzlR17KkHD55iZPPHlx0zHNWvM-fpnVedkSmhiGJffnzN0yAw May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 6e44eda8115b487cbc52d99ea0634686 May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesActionsTest-1092267362 May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:46.338943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6e44eda8115b487cbc52d99ea0634686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6e44eda8115b487cbc52d99ea0634686", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e44eda8115b487cbc52d99ea0634686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e44eda8115b487cbc52d99ea0634686"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesActionsTest-1092267362 May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 6e44eda8115b487cbc52d99ea0634686 May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesActionsTest-1092267362 May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesActionsTest-1092267362-project May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: c6a8a68cdea9415081cfd2a93e701cb8 May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesActionsTest-1092267362-project May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance ba587519-fd74-4b13-9cdc-ae45275cdafa could not be found. May 13 13:00:46.340478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'ba587519-fd74-4b13-9cdc-ae45275cdafa'} May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba587519-fd74-4b13-9cdc-ae45275cdafa could not be found. May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:46.341485 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba587519-fd74-4b13-9cdc-ae45275cdafa could not be found. May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba587519-fd74-4b13-9cdc-ae45275cdafa could not be found. May 13 13:00:46.343088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:46.345031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Returning 404 to user: Instance ba587519-fd74-4b13-9cdc-ae45275cdafa could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:46.345031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-9e0fd1c1-e99b-4306-998c-2dfeddbfbaf0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa" status: 404 len: 111 microversion: 2.1 time: 0.031130 May 13 13:00:46.345031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 313/647] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:46 2022] GET /compute/v2.1/servers/ba587519-fd74-4b13-9cdc-ae45275cdafa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:46.451837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1533338326", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "networks": [{"uuid": "9adf0a94-4216-4043-b976-598165f0772b"}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:46.501560 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] validate_networks() for [('9adf0a94-4216-4043-b976-598165f0772b', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:00:46.894698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:00:46.895128 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:00:46.895608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:00:46.896021 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:00:46.896436 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:00:46.905893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:46.906344 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:46.907155 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:46.907597 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:46.924267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Getting quotas for project 6e44eda8115b487cbc52d99ea0634686. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:00:46.928233 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Getting quotas for user c6a8a68cdea9415081cfd2a93e701cb8 and project 6e44eda8115b487cbc52d99ea0634686. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:00:46.939969 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:00:46.942301 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:00:46.991509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e894ca1c-7f60-48c9-961b-a120b6f91f1e tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544233 May 13 13:00:46.992506 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 335/648] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:00:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:00:47.002821 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ac283739-7b5b-4998-b83d-f4433cc24d5b tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:47.003454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ac283739-7b5b-4998-b83d-f4433cc24d5b tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:47.024153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-951079cd-acf8-44be-89dd-3e7417155d39 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:47.025292 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-951079cd-acf8-44be-89dd-3e7417155d39 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:47.032314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-951079cd-acf8-44be-89dd-3e7417155d39 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.032893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-951079cd-acf8-44be-89dd-3e7417155d39 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.033832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-951079cd-acf8-44be-89dd-3e7417155d39 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.034369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-951079cd-acf8-44be-89dd-3e7417155d39 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.068668 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ac283739-7b5b-4998-b83d-f4433cc24d5b tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:47.069404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-951079cd-acf8-44be-89dd-3e7417155d39 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049334 May 13 13:00:47.070088 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 336/649] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:00:47 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 13:00:47.075779 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ac283739-7b5b-4998-b83d-f4433cc24d5b tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1214 microversion: 2.1 time: 0.077384 May 13 13:00:47.076495 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 314/650] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:46 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:00:47.128381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:47.128877 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:47.134889 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.135331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.136094 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.136524 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.161302 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:00:47.245738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4fba3d80-4441-4a09-99c1-800e2028cb99 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 204 len: 0 microversion: 2.1 time: 0.121601 May 13 13:00:47.249313 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 337/651] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:47 2022] DELETE /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:00:47.254718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:47.255339 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:47.261371 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.261863 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.262679 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.263193 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.395793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:47.403232 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d3bcae9e-5bd1-49af-979c-8eb05bca4fd6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1679 microversion: 2.1 time: 0.152421 May 13 13:00:47.403812 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 315/652] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:47 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:47.705494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4f582545-b557-4525-9090-216a32e22d19 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:47.706505 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4f582545-b557-4525-9090-216a32e22d19 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:47.712298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f582545-b557-4525-9090-216a32e22d19 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.712747 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f582545-b557-4525-9090-216a32e22d19 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.713547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f582545-b557-4525-9090-216a32e22d19 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.713974 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4f582545-b557-4525-9090-216a32e22d19 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.741915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4f582545-b557-4525-9090-216a32e22d19 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041487 May 13 13:00:47.742479 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 338/653] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:00:47 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:00:47.843798 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-54704765-66bb-4af3-b93d-5db0a2e84026 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:47.844804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-54704765-66bb-4af3-b93d-5db0a2e84026 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:47.850667 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-54704765-66bb-4af3-b93d-5db0a2e84026 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.851128 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-54704765-66bb-4af3-b93d-5db0a2e84026 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.851906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-54704765-66bb-4af3-b93d-5db0a2e84026 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.852342 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-54704765-66bb-4af3-b93d-5db0a2e84026 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.882114 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-54704765-66bb-4af3-b93d-5db0a2e84026 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042366 May 13 13:00:47.882668 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 316/654] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:00:47 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:00:47.938866 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:47.939372 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:47.945252 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.945705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.946473 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:47.946916 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:47.972372 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:00:48.046244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2a36be96-cc95-4984-a550-71df777fff8b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 204 len: 0 microversion: 2.1 time: 0.111164 May 13 13:00:48.046955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 339/655] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:47 2022] DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:00:48.055162 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:48.055775 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:48.061556 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:48.062168 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:48.062933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:48.063373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:48.092220 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:48.093170 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:48.100066 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:48.100672 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:48.101504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:48.101950 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:48.165036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:48.172360 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-90d7152a-a819-445f-8abe-5bd2fb893008 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1218 microversion: 2.1 time: 0.084322 May 13 13:00:48.172926 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 340/656] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:48 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:00:48.192498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:48.199776 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ae9ae22a-37a5-4b7b-a62d-e02ddf71837d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1672 microversion: 2.1 time: 0.148518 May 13 13:00:48.200332 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 317/657] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:48 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:48.424273 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:48.424890 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:48.431005 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:48.431460 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:48.432225 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:48.432659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:48.565403 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:48.572927 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-cbc2bd07-7443-4690-a8a7-7691eb34899c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1679 microversion: 2.1 time: 0.152540 May 13 13:00:48.573535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 341/658] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:48 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:49.190260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:49.190871 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:49.197201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:49.197653 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:49.198418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:49.198855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:49.217245 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:49.217869 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:49.224396 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:49.224793 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:49.225622 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:49.226071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:49.259935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:49.267766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8a84cae2-4ca1-497c-bb1f-4c879cb8b822 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1218 microversion: 2.1 time: 0.082504 May 13 13:00:49.268354 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 318/659] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:49 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:49.355524 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:49.363353 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-22ce31ec-a218-4372-a1ba-b23e8e2fd6dd tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1672 microversion: 2.1 time: 0.150030 May 13 13:00:49.363939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 342/660] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:49 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:00:49.590907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:49.591452 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:49.597498 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:49.597957 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:49.598734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:49.599178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:49.726142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:49.733384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b717f0a5-f443-42d4-8b38-bd0c04b05d6b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1679 microversion: 2.1 time: 0.146317 May 13 13:00:49.733961 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 319/661] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:49 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:50.284472 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:50.285005 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:50.291833 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:50.292283 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:50.293071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:50.293509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:50.357746 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:50.365310 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7f3778dc-9dc7-4da9-87af-ad4063c6c292 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1218 microversion: 2.1 time: 0.085479 May 13 13:00:50.365943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 343/662] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:50 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:50.379551 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:50.380169 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:50.386474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:50.386928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:50.387693 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:50.388134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:50.512484 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:50.521049 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e33be6a9-b3e5-4ef0-a582-45992191d19e tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1672 microversion: 2.1 time: 0.145317 May 13 13:00:50.521649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 320/663] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:50 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:50.751429 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:50.752047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:50.757978 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:50.758428 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:50.759196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:50.759638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:50.889672 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:50.898212 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7c6cf4b1-e7bc-407e-8add-28d695a7f358 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1679 microversion: 2.1 time: 0.151199 May 13 13:00:50.908389 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 344/664] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:50 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:51.382620 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:51.383279 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:51.393363 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:51.394387 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:51.395194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:51.396215 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:51.539683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:51.540531 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:51.548548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:51.550145 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:51.551360 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:51.552040 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:51.568677 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:51.576732 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ec4ae52f-bad0-447c-a604-369756548dcf tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1274 microversion: 2.1 time: 0.198224 May 13 13:00:51.577373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 321/665] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:51 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:51.642894 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc7138e3d5438b9a96744e22add357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e091db3cd14ecb9c40257451cd434d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:51.651528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f77613cc-c226-4989-bba5-25e019bd74a2 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 200 len: 1605 microversion: 2.1 time: 0.116481 May 13 13:00:51.652580 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 345/666] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:51 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 1605 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:51.904344 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-b06c8100-5ee8-402a-8ca5-37feda137e30 req-814db2e7-ff2e-4ada-9c79-dcaf8bf99f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dc3686-a1be-4e57-8d5a-9d1f94f597d1", "name": "network-vif-deleted", "tag": "5ac86e19-cc6f-4364-9f1f-30cab19c886a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:51.917159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:51.919278 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:51.947810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:51.950305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:51.951184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-b06c8100-5ee8-402a-8ca5-37feda137e30 req-814db2e7-ff2e-4ada-9c79-dcaf8bf99f8d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:51.951716 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-b06c8100-5ee8-402a-8ca5-37feda137e30 req-814db2e7-ff2e-4ada-9c79-dcaf8bf99f8d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:51.956205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:51.958134 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:52.021971 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-b06c8100-5ee8-402a-8ca5-37feda137e30 req-814db2e7-ff2e-4ada-9c79-dcaf8bf99f8d service nova] Creating event network-vif-deleted:5ac86e19-cc6f-4364-9f1f-30cab19c886a for instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 on hv-cinder-84164 May 13 13:00:52.033332 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-b06c8100-5ee8-402a-8ca5-37feda137e30 req-814db2e7-ff2e-4ada-9c79-dcaf8bf99f8d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216867 May 13 13:00:52.036556 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 322/667] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:52.091688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:52.102177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-be61c117-d714-43b0-9368-274bac34d80d tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1611 microversion: 2.1 time: 0.189452 May 13 13:00:52.103774 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 346/668] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:51 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1611 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:00:52.405373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-ca4b59e9-bc2c-4242-8afa-d4c4ab0dffd4 req-4dffc428-b7f6-41d8-a3e8-fd6b97c6921c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b33371a-b63f-4932-a850-1b16b2bbd393", "name": "network-vif-deleted", "tag": "63c9af63-3627-4908-ba96-ff2fd8ff4b4a"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:52.417749 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-ca4b59e9-bc2c-4242-8afa-d4c4ab0dffd4 req-4dffc428-b7f6-41d8-a3e8-fd6b97c6921c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:52.418148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-ca4b59e9-bc2c-4242-8afa-d4c4ab0dffd4 req-4dffc428-b7f6-41d8-a3e8-fd6b97c6921c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:52.453104 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-ca4b59e9-bc2c-4242-8afa-d4c4ab0dffd4 req-4dffc428-b7f6-41d8-a3e8-fd6b97c6921c service nova] Creating event network-vif-deleted:63c9af63-3627-4908-ba96-ff2fd8ff4b4a for instance 0b33371a-b63f-4932-a850-1b16b2bbd393 on hv-cinder-84164 May 13 13:00:52.461292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-ca4b59e9-bc2c-4242-8afa-d4c4ab0dffd4 req-4dffc428-b7f6-41d8-a3e8-fd6b97c6921c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059832 May 13 13:00:52.461986 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 323/669] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:52.595894 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:52.596484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:52.607957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:52.608701 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:52.611227 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:52.612527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:52.669503 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:52.670497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:52.683130 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:52.683875 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:52.684852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:52.685476 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:52.709909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] HTTP exception thrown: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Request method failure captured: May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 HTTP/1.1 May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflVRFhIcQr6hEurLPjf0Keg-nQ98YzlMsCFRZNNPpvvm8bZwV7PCcdSdBH81EPJzqjfCBOxdTcRdODqnB_g4ATH2rp8GzyAbNQaJ1Y0RpTbQps_NLJJrTrJDhJRXk9uIPYT7NA18aySj8sfQhhmiLccHZ61xN2_S0g3kOKUvFUBmE_4 May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:52.715542 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8e091db3cd14ecb9c40257451cd434d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 88bc7138e3d5438b9a96744e22add357 May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:52.716933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '80dc3686-a1be-4e57-8d5a-9d1f94f597d1'} May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:52.717726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:52.719899 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:52.722982 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Returning 404 to user: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:52.727228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:52.736181 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-be016763-bdb4-435f-845a-92b888b4d850 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1272 microversion: 2.1 time: 0.144956 May 13 13:00:52.736794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3d412091-b782-4ff0-ba16-f3f63a191024 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 404 len: 111 microversion: 2.1 time: 0.065813 May 13 13:00:52.737698 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 324/670] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:52 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:00:52.749486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 347/671] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:52 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:52.753079 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-19469682-15b1-4d4d-bf2f-c90287c27f67 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '.version_select at 0x7f0601f35430>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:52.778786 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-19469682-15b1-4d4d-bf2f-c90287c27f67 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75544264" status: 202 len: 0 microversion: 2.1 time: 0.029809 May 13 13:00:52.779530 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 325/672] 10.222.0.49 () {58 vars in 1214 bytes} [Fri May 13 13:00:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75544264 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:00:53.120906 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:53.122043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:53.130985 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:53.131431 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:53.132332 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:53.132883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:53.208127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:53.208626 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:53.210950 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lazy-loading 'fault' on Instance uuid 0b33371a-b63f-4932-a850-1b16b2bbd393 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:00:53.278072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c8941361fb4800ad0574237c9ac377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec55859792345359fc7b22003b4e995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:53.288461 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ae88f610-f67d-4106-9b8c-1b5e15898154 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 200 len: 1331 microversion: 2.1 time: 0.171606 May 13 13:00:53.289453 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 348/673] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:53 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 1331 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:53.756046 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:53.756758 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:53.767375 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:53.767729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:53.776481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:53.776950 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:53.983544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:53.991288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-225d2b61-56f9-462f-9523-8115f500c269 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1314 microversion: 2.1 time: 0.239172 May 13 13:00:53.991863 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 326/674] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:53 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:00:54.305634 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:54.306358 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:54.313510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:54.314145 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:54.314921 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:54.315356 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:54.331131 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 HTTP/1.1 May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:00:54.332778 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:54.334955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '0b33371a-b63f-4932-a850-1b16b2bbd393'} May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:54.335826 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:54.337267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:54.339096 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:54.339096 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f27dff2c-13cd-42a4-8b78-f9141e8bb32c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 404 len: 111 microversion: 2.1 time: 0.032470 May 13 13:00:54.339096 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 349/675] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:54 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:54.343866 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-176f6496-a397-4a22-a1f6-3621e053ce5c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '.version_select at 0x7f0601f35a60>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:54.361260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-176f6496-a397-4a22-a1f6-3621e053ce5c tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067688971" status: 202 len: 0 microversion: 2.1 time: 0.021715 May 13 13:00:54.361828 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 327/676] 10.222.0.49 () {58 vars in 1220 bytes} [Fri May 13 13:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067688971 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:00:54.476936 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-84a5fae5-da4e-43b5-a580-4b3c4e6e759c req-8d1dcce5-fcbf-4462-84ef-e6aa40ddcb51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b0e32f-563b-4525-95b2-a499295bb569", "tag": "43597710-3597-4f20-8cef-dbaaf7959d84"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:54.486923 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-84a5fae5-da4e-43b5-a580-4b3c4e6e759c req-8d1dcce5-fcbf-4462-84ef-e6aa40ddcb51 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:54.487365 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-84a5fae5-da4e-43b5-a580-4b3c4e6e759c req-8d1dcce5-fcbf-4462-84ef-e6aa40ddcb51 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:54.498695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-84a5fae5-da4e-43b5-a580-4b3c4e6e759c req-8d1dcce5-fcbf-4462-84ef-e6aa40ddcb51 service nova] Creating event network-changed:43597710-3597-4f20-8cef-dbaaf7959d84 for instance 22b0e32f-563b-4525-95b2-a499295bb569 on hv-cinder-84164 May 13 13:00:54.504055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-84a5fae5-da4e-43b5-a580-4b3c4e6e759c req-8d1dcce5-fcbf-4462-84ef-e6aa40ddcb51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031083 May 13 13:00:54.505014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 350/677] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:00:55.008046 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:55.008654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:55.014543 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:55.014998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:55.015767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:55.016391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:55.155833 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:55.163449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0b7199ea-78ae-4312-85ff-f7cc49bcbde6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1314 microversion: 2.1 time: 0.159680 May 13 13:00:55.163994 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 328/678] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:55 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:55.992576 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:55.993238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:55.999244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:55.999689 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.000448 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.000917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.015037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] HTTP exception thrown: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Request method failure captured: May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 HTTP/1.1 May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflVRFhIcQr6hEurLPjf0Keg-nQ98YzlMsCFRZNNPpvvm8bZwV7PCcdSdBH81EPJzqjfCBOxdTcRdODqnB_g4ATH2rp8GzyAbNQaJ1Y0RpTbQps_NLJJrTrJDhJRXk9uIPYT7NA18aySj8sfQhhmiLccHZ61xN2_S0g3kOKUvFUBmE_4 May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:00:56.017172 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8e091db3cd14ecb9c40257451cd434d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 88bc7138e3d5438b9a96744e22add357 May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.018752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '80dc3686-a1be-4e57-8d5a-9d1f94f597d1'} May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:56.019616 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.021028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.022423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Returning 404 to user: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:56.022423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-714a86e6-8663-436b-b539-d2a3f19bf87b tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 404 len: 111 microversion: 2.1 time: 0.030750 May 13 13:00:56.022423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 351/679] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:55 2022] DELETE /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:56.027030 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:56.027653 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: 80dc3686-a1be-4e57-8d5a-9d1f94f597d1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:56.034737 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.035185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.036213 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.036646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.049497 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] HTTP exception thrown: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Request method failure captured: May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 HTTP/1.1 May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflVRFhIcQr6hEurLPjf0Keg-nQ98YzlMsCFRZNNPpvvm8bZwV7PCcdSdBH81EPJzqjfCBOxdTcRdODqnB_g4ATH2rp8GzyAbNQaJ1Y0RpTbQps_NLJJrTrJDhJRXk9uIPYT7NA18aySj8sfQhhmiLccHZ61xN2_S0g3kOKUvFUBmE_4 May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:56.050996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8e091db3cd14ecb9c40257451cd434d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 88bc7138e3d5438b9a96744e22add357 May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.052518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '80dc3686-a1be-4e57-8d5a-9d1f94f597d1'} May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:56.053346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. May 13 13:00:56.054493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.055526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Returning 404 to user: Instance 80dc3686-a1be-4e57-8d5a-9d1f94f597d1 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:56.055526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-892aafee-2972-4f64-b0c6-937e16543e9d tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1" status: 404 len: 111 microversion: 2.1 time: 0.029193 May 13 13:00:56.055526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 329/680] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:56 2022] GET /compute/v2.1/servers/80dc3686-a1be-4e57-8d5a-9d1f94f597d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:56.128961 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:56.129495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:56.135828 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.136296 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.137842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.138458 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.154028 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: DELETE /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 HTTP/1.1 May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:00:56.155591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.158023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '0b33371a-b63f-4932-a850-1b16b2bbd393'} May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:56.159154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.160847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:56.162427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:56.162427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8c4ad1a7-edad-4b7e-b0a7-1cfd1d3398b8 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 404 len: 111 microversion: 2.1 time: 0.031971 May 13 13:00:56.162427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 352/681] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:56 2022] DELETE /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:56.166660 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:56.167338 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 0b33371a-b63f-4932-a850-1b16b2bbd393] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:56.173163 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.173628 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.174642 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.175098 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.179399 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:56.180020 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:56.185940 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.186398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.187189 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:56.187627 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:56.188201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 HTTP/1.1 May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:56.189988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.191481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '0b33371a-b63f-4932-a850-1b16b2bbd393'} May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:56.192209 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. May 13 13:00:56.193569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:56.194818 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 0b33371a-b63f-4932-a850-1b16b2bbd393 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:56.194818 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2e5532ee-5a87-4ec5-805f-22f514b770ae tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393" status: 404 len: 111 microversion: 2.1 time: 0.028652 May 13 13:00:56.194818 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 330/682] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:56 2022] GET /compute/v2.1/servers/0b33371a-b63f-4932-a850-1b16b2bbd393 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:56.320323 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:56.327508 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-df84cbaf-eee2-496e-a55b-43da54f090a0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1314 microversion: 2.1 time: 0.151873 May 13 13:00:56.328076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 353/683] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:56 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:00:57.179266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:57.179786 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:57.185739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.186186 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.186955 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.187396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.201394 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] HTTP exception thrown: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Request method failure captured: May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 HTTP/1.1 May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflVRFhIcQr6hEurLPjf0Keg-nQ98YzlMsCFRZNNPpvvm8bZwV7PCcdSdBH81EPJzqjfCBOxdTcRdODqnB_g4ATH2rp8GzyAbNQaJ1Y0RpTbQps_NLJJrTrJDhJRXk9uIPYT7NA18aySj8sfQhhmiLccHZ61xN2_S0g3kOKUvFUBmE_4 May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:57.202934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8e091db3cd14ecb9c40257451cd434d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 88bc7138e3d5438b9a96744e22add357 May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.205152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'a805ac8a-8fbf-4bf1-b369-64eaef204809'} May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:57.206015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.207728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.209515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Returning 404 to user: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:57.209515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-88b85200-52c1-49c5-bf9a-6e498aab3238 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 404 len: 111 microversion: 2.1 time: 0.028950 May 13 13:00:57.209515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 331/684] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:57 2022] DELETE /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:57.214956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:57.215579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] [instance: a805ac8a-8fbf-4bf1-b369-64eaef204809] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:57.222056 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.222519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.223298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.223740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.237254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] HTTP exception thrown: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Request method failure captured: May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 HTTP/1.1 May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflVRFhIcQr6hEurLPjf0Keg-nQ98YzlMsCFRZNNPpvvm8bZwV7PCcdSdBH81EPJzqjfCBOxdTcRdODqnB_g4ATH2rp8GzyAbNQaJ1Y0RpTbQps_NLJJrTrJDhJRXk9uIPYT7NA18aySj8sfQhhmiLccHZ61xN2_S0g3kOKUvFUBmE_4 May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:00:57.238794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8e091db3cd14ecb9c40257451cd434d", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8e091db3cd14ecb9c40257451cd434d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: a8e091db3cd14ecb9c40257451cd434d May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1591423219 May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 88bc7138e3d5438b9a96744e22add357 May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeTestJSON-1591423219-project May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.240097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': 'a805ac8a-8fbf-4bf1-b369-64eaef204809'} May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:57.240837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. May 13 13:00:57.242047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:57.243094 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] Returning 404 to user: Instance a805ac8a-8fbf-4bf1-b369-64eaef204809 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:57.243094 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e9312be1-eb2d-4e14-8694-f9a207e862e4 tempest-AttachVolumeTestJSON-1591423219 tempest-AttachVolumeTestJSON-1591423219-project] 10.222.0.49 "GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809" status: 404 len: 111 microversion: 2.1 time: 0.029171 May 13 13:00:57.243094 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 354/685] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:57 2022] GET /compute/v2.1/servers/a805ac8a-8fbf-4bf1-b369-64eaef204809 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:57.325528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:57.326091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:57.332759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.333327 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.334198 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.334709 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.345421 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:57.346052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:57.349895 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 HTTP/1.1 May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:57.351520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.353119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '70fd3419-f741-4630-b0a8-288fd40f27d0'} May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:57.354044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.355507 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.356912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.356912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.357236 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:57.357338 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.357338 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.357510 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ff55938e-bdf3-43ac-8b75-28d9c32f08f6 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 404 len: 111 microversion: 2.1 time: 0.032606 May 13 13:00:57.357510 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 332/686] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:57 2022] DELETE /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:57.364562 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:57.365344 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 70fd3419-f741-4630-b0a8-288fd40f27d0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:57.371401 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.371969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.372850 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.373403 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.387221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 HTTP/1.1 May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:57.388963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.390538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '70fd3419-f741-4630-b0a8-288fd40f27d0'} May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:57.393571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. May 13 13:00:57.394867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.396102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 70fd3419-f741-4630-b0a8-288fd40f27d0 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:57.396102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-03c4463f-a6d3-43fa-bfbf-f9ab8151ead9 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0" status: 404 len: 111 microversion: 2.1 time: 0.029838 May 13 13:00:57.396102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 333/687] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:57 2022] GET /compute/v2.1/servers/70fd3419-f741-4630-b0a8-288fd40f27d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:00:57.399318 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:57.399823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:57.405932 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.406396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.407458 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.407647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.423046 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 HTTP/1.1 May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:57.424720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.426248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '42b7e01b-70b1-46a0-96f0-1c412e18c5e1'} May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:57.427063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.428205 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.429618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:57.429618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-bdb07a87-f76c-4a85-b33a-dcde249096b2 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 404 len: 111 microversion: 2.1 time: 0.030480 May 13 13:00:57.429618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 334/688] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:57 2022] DELETE /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:00:57.434622 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:57.435325 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 42b7e01b-70b1-46a0-96f0-1c412e18c5e1] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:57.442107 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.442646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.443442 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:57.443882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:57.458724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 HTTP/1.1 May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:57.460281 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.461849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '42b7e01b-70b1-46a0-96f0-1c412e18c5e1'} May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:57.462647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. May 13 13:00:57.463793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:57.464839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 42b7e01b-70b1-46a0-96f0-1c412e18c5e1 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:57.464839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4d45264d-6eaa-4c12-9087-370b080a5f2b tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1" status: 404 len: 111 microversion: 2.1 time: 0.030893 May 13 13:00:57.464839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 335/689] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:57 2022] GET /compute/v2.1/servers/42b7e01b-70b1-46a0-96f0-1c412e18c5e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:57.836731 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:57.844675 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6805b5bb-08d3-453f-8bd2-5826177e986a tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1314 microversion: 2.1 time: 0.503411 May 13 13:00:57.845547 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 355/690] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:57 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:00:58.616284 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:58.617488 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:58.624425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:58.625005 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:58.626413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:58.626922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:58.649702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 HTTP/1.1 May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:00:58.651308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.652654 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '34789621-2e0a-4fef-8268-7703885edac6'} May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:58.653791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.654996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:00:58.657832 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:58.657832 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e6dc200d-991a-418a-b820-fa524c3c6151 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 404 len: 111 microversion: 2.1 time: 0.040554 May 13 13:00:58.657832 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 336/691] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:00:58 2022] DELETE /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:58.663830 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:58.664462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] [instance: 34789621-2e0a-4fef-8268-7703885edac6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:58.671205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:58.671679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:58.672508 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:58.674092 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:58.687802 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] HTTP exception thrown: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Request method failure captured: May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 HTTP/1.1 May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflUUvP_oung3Hhszrd9QuoW9xfwNiwJVA6iEqBGJqMSqMH9aiFECCceVYAJIJuJlhwgMbYrVG5x-k8VP-CMmRUQBS_EMNxRoESdtIe4Li1_ndFHKxRYvhp7cYlH5w8si5-nFZ7UNTo_y423aCmUDHl5TVChDKR6yABRT6BC6PLbW2o8 May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:00:58.690540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ec55859792345359fc7b22003b4e995"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ec55859792345359fc7b22003b4e995", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ec55859792345359fc7b22003b4e995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7ec55859792345359fc7b22003b4e995 May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545671576 May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: b8c8941361fb4800ad0574237c9ac377 May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeNegativeTest-1545671576-project May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.692011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '34789621-2e0a-4fef-8268-7703885edac6'} May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:00:58.692720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. May 13 13:00:58.693984 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:00:58.695009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] Returning 404 to user: Instance 34789621-2e0a-4fef-8268-7703885edac6 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:00:58.695009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8d64c77e-c4ef-4a84-a97e-8e6424842b44 tempest-AttachVolumeNegativeTest-1545671576 tempest-AttachVolumeNegativeTest-1545671576-project] 10.222.0.49 "GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6" status: 404 len: 111 microversion: 2.1 time: 0.032455 May 13 13:00:58.695009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 356/692] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:58 2022] GET /compute/v2.1/servers/34789621-2e0a-4fef-8268-7703885edac6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:00:58.862368 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:00:58.863314 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:00:58.869421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:58.869944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:58.870786 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:58.871329 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:59.131476 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:00:59.140392 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cbecf25e-7d8f-465e-b29f-99d7f5106f68 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1314 microversion: 2.1 time: 0.282241 May 13 13:00:59.147907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 337/693] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:00:58 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:00:59.214254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-b0dad25c-6339-498c-a35d-c91a1af9074c req-560576c8-7a0a-4389-b4d7-4fde280fe5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0e32f-563b-4525-95b2-a499295bb569", "name": "network-vif-plugged", "status": "completed", "tag": "43597710-3597-4f20-8cef-dbaaf7959d84"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:00:59.227585 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-b0dad25c-6339-498c-a35d-c91a1af9074c req-560576c8-7a0a-4389-b4d7-4fde280fe5eb service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:00:59.228081 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-b0dad25c-6339-498c-a35d-c91a1af9074c req-560576c8-7a0a-4389-b4d7-4fde280fe5eb service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:00:59.253704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-b0dad25c-6339-498c-a35d-c91a1af9074c req-560576c8-7a0a-4389-b4d7-4fde280fe5eb service nova] Creating event network-vif-plugged:43597710-3597-4f20-8cef-dbaaf7959d84 for instance 22b0e32f-563b-4525-95b2-a499295bb569 on hv-cinder-84164 May 13 13:00:59.265748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-b0dad25c-6339-498c-a35d-c91a1af9074c req-560576c8-7a0a-4389-b4d7-4fde280fe5eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054477 May 13 13:00:59.267896 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 357/694] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:01:00.167352 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:00.168668 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:00.180562 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:00.181385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:00.182796 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:00.186777 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:00.714068 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:00.728084 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8f0d49db-07d8-4eb2-ab6a-3916a05b7a86 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1314 microversion: 2.1 time: 0.565455 May 13 13:01:00.729297 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 338/695] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:00 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:01.746847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:01.747637 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:01.754610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:01.755064 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:01.755879 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:01.756322 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:01.930178 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:01.941784 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b029625d-50ae-4b8c-9d4c-03de5aa5d3e6 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1314 microversion: 2.1 time: 0.198958 May 13 13:01:01.942362 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 358/696] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:01 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:02.959078 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:02.960397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:02.966703 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:02.967355 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:02.968131 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:02.968729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.128294 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:03.135684 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-48f153d6-795a-4466-9590-d36fc2b6b8d3 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1498 microversion: 2.1 time: 0.180518 May 13 13:01:03.136358 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 339/697] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:02 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:03.673449 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:03.674182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:03.680694 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.681194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.682040 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.682485 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.710473 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:01:03.712663 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-77809485-d07a-4831-9a83-340661cbdebb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:03.713634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-77809485-d07a-4831-9a83-340661cbdebb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:03.719378 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77809485-d07a-4831-9a83-340661cbdebb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.719893 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77809485-d07a-4831-9a83-340661cbdebb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.720681 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77809485-d07a-4831-9a83-340661cbdebb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.721165 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-77809485-d07a-4831-9a83-340661cbdebb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.753177 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-77809485-d07a-4831-9a83-340661cbdebb tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044233 May 13 13:01:03.754086 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 340/698] 10.222.0.49 () {60 vars in 1342 bytes} [Fri May 13 13:01:03 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:01:03.795418 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-838d7734-941a-4f71-a6b4-3ead22845475 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "DELETE /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 204 len: 0 microversion: 2.1 time: 0.125973 May 13 13:01:03.796007 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 359/699] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:01:03 2022] DELETE /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:01:03.809835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:03.810470 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:03.819704 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.820911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.821453 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:03.821884 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.822338 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.822443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:03.831977 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.832663 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.833580 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:03.834216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:03.867036 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:01:03.953450 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ed66d073-3cad-4bd7-a103-0cf651112a07 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 204 len: 0 microversion: 2.20 time: 0.137379 May 13 13:01:03.954579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 360/700] 10.222.0.49 () {60 vars in 1279 bytes} [Fri May 13 13:01:03 2022] DELETE /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:01:03.961530 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2742919a-2968-476e-ae14-4cbfcccc055e tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601fa5550>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:03.981520 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:03.989969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2e167727-1dbd-4541-91ea-dddc0ea9efc1 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1504 microversion: 2.1 time: 0.188560 May 13 13:01:03.990536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 341/701] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:03 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:04.005038 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:04.005646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:04.011650 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:04.012108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:04.012878 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:04.013344 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:04.017079 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2742919a-2968-476e-ae14-4cbfcccc055e tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7e043d22-57e0-425a-bc05-75b46f94c81b" status: 200 len: 351 microversion: 2.1 time: 0.060592 May 13 13:01:04.017868 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 361/702] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:03 2022] GET /compute/v2.1/os-volumes/7e043d22-57e0-425a-bc05-75b46f94c81b => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:04.146774 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:04.155050 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:04.156933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:04.159265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cf9093e8-b175-4b18-8f05-0860dd34fc6d tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.157948 May 13 13:01:04.160113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 342/703] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:04 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:01:04.174444 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8e623979-a674-4568-9d79-803afa701286 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Action: 'create', calling method: .version_select at 0x7f0601eda040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1399905428"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:04.474651 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8e623979-a674-4568-9d79-803afa701286 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.428406 May 13 13:01:04.475281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 362/704] 10.222.0.49 () {60 vars in 1154 bytes} [Fri May 13 13:01:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 430 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 13 13:01:04.486225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2f7bacd8-713a-4ffc-a973-6f1b3f98f50e tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601efe0d0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:04.537770 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2f7bacd8-713a-4ffc-a973-6f1b3f98f50e tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a" status: 200 len: 345 microversion: 2.1 time: 0.055448 May 13 13:01:04.538353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 343/705] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:04 2022] GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:05.007976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:05.008721 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:05.014811 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:05.015190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:05.016012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:05.016423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:05.146370 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:05.153819 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e4403bc0-2e10-4ece-8904-b8215e937038 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1504 microversion: 2.1 time: 0.150198 May 13 13:01:05.154339 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 363/706] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:05 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:05.178837 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:05.179618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:05.185549 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:05.186002 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:05.186850 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:05.187311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:05.319011 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:05.326799 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:05.328288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:05.329551 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7d39f40b-91ca-4bda-9b7e-68344352f352 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.155037 May 13 13:01:05.330092 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 344/707] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:05 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:01:05.349397 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4e17d55d-0b9d-444d-8923-0661bd943cad tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601edaf70>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:05.394686 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4e17d55d-0b9d-444d-8923-0661bd943cad tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fef1bb80-c47a-49d0-a52b-91f8b39a0236" status: 200 len: 351 microversion: 2.1 time: 0.048934 May 13 13:01:05.395250 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 364/708] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:05 2022] GET /compute/v2.1/os-volumes/fef1bb80-c47a-49d0-a52b-91f8b39a0236 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:05.550743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3152eda3-649d-40c6-b1bc-62dddfe786bc tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601e8b5e0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:05.603823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3152eda3-649d-40c6-b1bc-62dddfe786bc tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a" status: 200 len: 346 microversion: 2.1 time: 0.057440 May 13 13:01:05.604782 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 345/709] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:05 2022] GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:05.617492 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e8ee8ee9-ee9d-4801-b8b6-533ba3347a80 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Action: 'create', calling method: .version_select at 0x7f0601eda5e0>, body: {"snapshot": {"volume_id": "77bfb4d3-1141-4083-894d-e25a85b09b3a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-216722594"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:05.771183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e8ee8ee9-ee9d-4801-b8b6-533ba3347a80 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.158492 May 13 13:01:05.771815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 365/710] 10.222.0.49 () {60 vars in 1161 bytes} [Fri May 13 13:01:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:05.781539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5aaa5305-8748-417c-83d3-571a8ab4af34 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601f39d30>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:05.810743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5aaa5305-8748-417c-83d3-571a8ab4af34 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 200 len: 286 microversion: 2.1 time: 0.032990 May 13 13:01:05.811305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 346/711] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:05 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:05.821136 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-80452c63-25f5-4f0b-bdd5-0a83906d43cd tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0602100a60>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:05.850503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-80452c63-25f5-4f0b-bdd5-0a83906d43cd tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033139 May 13 13:01:05.851079 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 366/712] 10.222.0.49 () {58 vars in 1139 bytes} [Fri May 13 13:01:05 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:05.860875 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e9a7d12c-0953-4070-9f4c-ff4378994e45 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601ea0820>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:05.888367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e9a7d12c-0953-4070-9f4c-ff4378994e45 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 200 len: 286 microversion: 2.1 time: 0.031227 May 13 13:01:05.888934 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 347/713] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:05 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:06.171561 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:06.172176 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:06.178926 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:06.179375 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:06.180135 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:06.180570 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:06.304626 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:06.312162 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-47dd0a9b-2dc1-4749-a31e-79c67debe0f0 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1504 microversion: 2.1 time: 0.145053 May 13 13:01:06.312822 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 367/714] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:06 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:01:06.348576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:06.349227 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:06.355108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:06.355568 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:06.356337 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:06.356781 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:06.487848 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:06.495405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:06.496907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:06.498090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6afbea00-e505-46aa-9290-d50b8732403e tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.154414 May 13 13:01:06.498740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 348/715] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:06 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:01:06.704343 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4699ba2a-74b6-4d76-b880-124ad425c656 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601f31ee0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:06.748750 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4699ba2a-74b6-4d76-b880-124ad425c656 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8802c8a3-4000-4d2c-8966-e5c87b42f70a" status: 200 len: 350 microversion: 2.1 time: 0.048111 May 13 13:01:06.749357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 368/716] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:06 2022] GET /compute/v2.1/os-volumes/8802c8a3-4000-4d2c-8966-e5c87b42f70a => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:06.760590 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b52c9d7e-98d5-4021-92eb-2204d8c83cfd tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601efeb80>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:06.840012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b52c9d7e-98d5-4021-92eb-2204d8c83cfd tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083088 May 13 13:01:06.840603 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 349/717] 10.222.0.49 () {58 vars in 1133 bytes} [Fri May 13 13:01:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:06.852582 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-bed5b87c-ace1-450a-8504-e75fc3849d5e tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601eda280>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:06.899477 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-82e88505-00cc-48b3-be2b-13c2b6a75c08 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601fede50>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:06.928651 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-82e88505-00cc-48b3-be2b-13c2b6a75c08 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 200 len: 286 microversion: 2.1 time: 0.032864 May 13 13:01:06.929383 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 350/718] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:06 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:01:06.933716 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-bed5b87c-ace1-450a-8504-e75fc3849d5e tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084366 May 13 13:01:06.934823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 369/719] 10.222.0.49 () {58 vars in 1148 bytes} [Fri May 13 13:01:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:06.947336 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f28340e1-6117-4c23-8103-0e5fc46ad141 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601ea0430>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.027202 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f28340e1-6117-4c23-8103-0e5fc46ad141 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083595 May 13 13:01:07.027800 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 351/720] 10.222.0.49 () {58 vars in 1133 bytes} [Fri May 13 13:01:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:07.039072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a21cd362-acb9-4b28-a544-4a922ab1ff6e tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601f1aee0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.137145 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a21cd362-acb9-4b28-a544-4a922ab1ff6e tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101875 May 13 13:01:07.137765 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 370/721] 10.222.0.49 () {58 vars in 1166 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:07.149302 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dcc0b686-41ad-4b9e-a7dd-c147304f73c0 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601ea0dc0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.226803 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dcc0b686-41ad-4b9e-a7dd-c147304f73c0 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081341 May 13 13:01:07.227373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 352/722] 10.222.0.49 () {58 vars in 1169 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:07.239987 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4ade06de-f442-4167-ba19-aa0c6b2c23f2 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601edae50>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.320442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4ade06de-f442-4167-ba19-aa0c6b2c23f2 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085135 May 13 13:01:07.321041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 371/723] 10.222.0.49 () {58 vars in 1154 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:07.330783 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.331618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:07.331957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0f1bebea-91fc-4a13-992b-395b49dffb9c tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601f31dc0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.337632 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:07.338091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:07.338960 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:07.339408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:07.416607 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0f1bebea-91fc-4a13-992b-395b49dffb9c tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088574 May 13 13:01:07.417600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 372/724] 10.222.0.49 () {58 vars in 1187 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:01:07.429270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-aef700ca-7860-4966-8857-ab32f38b0847 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] Calling method '.version_select at 0x7f0601ebf160>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.473474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:07.480937 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b95a0bd9-365f-40fd-8ac0-76d2f5c58858 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1504 microversion: 2.1 time: 0.154169 May 13 13:01:07.481528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 353/725] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:07.513137 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-aef700ca-7860-4966-8857-ab32f38b0847 tempest-VolumesTestJSON-362958303 tempest-VolumesTestJSON-362958303-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087617 May 13 13:01:07.513717 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 373/726] 10.222.0.49 () {58 vars in 1154 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:01:07.515810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.516455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:07.522724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:07.523176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:07.523947 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:07.524389 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:07.655777 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:07.664492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:07.665998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:07.667158 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-87bbbc81-54b8-41f5-8e49-3d01e987c632 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.155318 May 13 13:01:07.667715 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 354/727] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:01:07.939644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-16703582-1347-4f24-85c4-47b8f28afc28 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601e93e50>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:07.967873 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-16703582-1347-4f24-85c4-47b8f28afc28 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 200 len: 286 microversion: 2.1 time: 0.032004 May 13 13:01:07.968440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 374/728] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:07 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:08.498470 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:08.499089 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:08.506116 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:08.506569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:08.507350 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:08.507793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:08.632461 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:08.639995 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e98fa45c-22ca-4923-ac22-d60416763304 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1504 microversion: 2.1 time: 0.145319 May 13 13:01:08.643451 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 355/729] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:08 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:08.685862 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:08.686418 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:08.693046 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:08.693507 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:08.694278 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:08.694726 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:08.823695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:08.831725 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:08.833412 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:08.834776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-23aff349-94dd-4b0d-8b29-029cbc6c972f tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.153359 May 13 13:01:08.835451 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 375/730] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:08 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:01:08.979537 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2ea05bb6-7c85-4327-b83d-c98554bba57c tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601ee9550>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:09.010957 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2ea05bb6-7c85-4327-b83d-c98554bba57c tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 200 len: 286 microversion: 2.1 time: 0.034979 May 13 13:01:09.011535 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 356/731] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:08 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:09.657043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:09.657652 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:09.664310 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:09.664760 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:09.665560 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:09.665994 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:09.822912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8a68cdea9415081cfd2a93e701cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e44eda8115b487cbc52d99ea0634686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:09.839110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e80cff76-37f6-4884-a3f8-90ac466e2c3f tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 200 len: 1504 microversion: 2.1 time: 0.185673 May 13 13:01:09.840418 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 376/732] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:09 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:09.852835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:09.853493 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:09.859834 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:09.860366 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:09.861840 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:09.862328 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:09.942613 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-63071d4c-caf7-4e38-aebe-110badb5aa5e req-c366e18a-4d3f-4ccd-b176-58a5968ccae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0e32f-563b-4525-95b2-a499295bb569", "name": "network-vif-deleted", "tag": "43597710-3597-4f20-8cef-dbaaf7959d84"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:09.951114 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-63071d4c-caf7-4e38-aebe-110badb5aa5e req-c366e18a-4d3f-4ccd-b176-58a5968ccae2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:09.951553 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-63071d4c-caf7-4e38-aebe-110badb5aa5e req-c366e18a-4d3f-4ccd-b176-58a5968ccae2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:09.976998 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-63071d4c-caf7-4e38-aebe-110badb5aa5e req-c366e18a-4d3f-4ccd-b176-58a5968ccae2 service nova] Creating event network-vif-deleted:43597710-3597-4f20-8cef-dbaaf7959d84 for instance 22b0e32f-563b-4525-95b2-a499295bb569 on hv-cinder-84164 May 13 13:01:09.982136 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-63071d4c-caf7-4e38-aebe-110badb5aa5e req-c366e18a-4d3f-4ccd-b176-58a5968ccae2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044204 May 13 13:01:09.982746 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 377/733] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:01:10.025008 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3593191e-8eec-43b1-8457-58c02c31d75c tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601eda940>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:10.057584 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3593191e-8eec-43b1-8457-58c02c31d75c tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 200 len: 287 microversion: 2.1 time: 0.036750 May 13 13:01:10.058158 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 378/734] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:10 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:01:10.068645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-33c32c81-9a9e-42ea-b555-2cb7f71b91c3 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601ee60d0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:10.131738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-33c32c81-9a9e-42ea-b555-2cb7f71b91c3 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 202 len: 0 microversion: 2.1 time: 0.066922 May 13 13:01:10.132495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 379/735] 10.222.0.49 () {58 vars in 1253 bytes} [Fri May 13 13:01:10 2022] DELETE /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:01:10.141212 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-96d3614e-fd81-4746-8db0-4bdb8c609a72 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601f3de50>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:10.174922 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-96d3614e-fd81-4746-8db0-4bdb8c609a72 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 200 len: 286 microversion: 2.1 time: 0.037304 May 13 13:01:10.175548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 380/736] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:10 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:01:10.345085 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:10.354260 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:10.355891 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9eb9ff59bef4adb83fbb4c5b358280a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b148a16abbc49ed816ed45fc1ad4980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:10.357223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e0ec9113-fd6f-4d0e-a3cb-8b03487a0aa0 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 200 len: 1724 microversion: 2.20 time: 0.508260 May 13 13:01:10.357867 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 357/737] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:09 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:01:10.857695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:10.858991 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] [instance: 22b0e32f-563b-4525-95b2-a499295bb569] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:10.874016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:10.874540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:10.875432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:10.875931 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:10.901576 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] HTTP exception thrown: Instance 22b0e32f-563b-4525-95b2-a499295bb569 could not be found. May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Request method failure captured: May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 HTTP/1.1 May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflZsTPpFQEUcCRa8SwYkGU6dfriNI7SsIHxucg8FE8PSHOtLxTy94-bvN6lYXwUSkZ5lEdXXiwG0uBJqqGSKbcw4xkrduZf6I5M_j97_DheFzJpwD3-BCEAFp3_9pKmzlR17KkHD55iZPPHlx0zHNWvM-fpnVedkSmhiGJffnzN0yAw May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 6e44eda8115b487cbc52d99ea0634686 May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-VolumesActionsTest-1092267362 May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:10.903785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6e44eda8115b487cbc52d99ea0634686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6e44eda8115b487cbc52d99ea0634686", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e44eda8115b487cbc52d99ea0634686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6e44eda8115b487cbc52d99ea0634686"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-VolumesActionsTest-1092267362 May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 6e44eda8115b487cbc52d99ea0634686 May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-VolumesActionsTest-1092267362 May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-VolumesActionsTest-1092267362-project May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: c6a8a68cdea9415081cfd2a93e701cb8 May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-VolumesActionsTest-1092267362-project May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 22b0e32f-563b-4525-95b2-a499295bb569 could not be found. May 13 13:01:10.905437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '22b0e32f-563b-4525-95b2-a499295bb569'} May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b0e32f-563b-4525-95b2-a499295bb569 could not be found. May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:10.906307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b0e32f-563b-4525-95b2-a499295bb569 could not be found. May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b0e32f-563b-4525-95b2-a499295bb569 could not be found. May 13 13:01:10.907723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:10.910881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] Returning 404 to user: Instance 22b0e32f-563b-4525-95b2-a499295bb569 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:10.912247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4ccc5c06-0384-4933-8be3-d60a839d21d9 tempest-VolumesActionsTest-1092267362 tempest-VolumesActionsTest-1092267362-project] 10.222.0.49 "GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569" status: 404 len: 111 microversion: 2.1 time: 0.058979 May 13 13:01:10.913074 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 381/738] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:10 2022] GET /compute/v2.1/servers/22b0e32f-563b-4525-95b2-a499295bb569 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:01:11.187563 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0f42651d-f984-408a-8e80-0cbc493412d2 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601f351f0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:11.215766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-0f42651d-f984-408a-8e80-0cbc493412d2 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] HTTP exception thrown: Snapshot c8b7d873-63ae-42de-b7bd-0ec18d897dc2 could not be found. May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0f42651d-f984-408a-8e80-0cbc493412d2 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Request method failure captured: May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 HTTP/1.1 May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflaPY3Y4aVvXhRaDJeYI5wpqXL6vAVVDyDh_IDsZ0eyIEqEmqTZrDe_ayK0d9HAX92PmU43E5TiMQAMjh73vqUI2s-cC-aYufeVcO4Gjqk01LFmOMsIBP_YzwgTFiJyk-3MDt2JSEBK3ME2a-ZxyN8o3hgpqgCQTNEzR1ridBmcmkAs May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:11.219862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c63fa9b6f9e47279ad31837791098f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 306cace1ddbf4091a1b3d4a733bdecc1 May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Snapshot c8b7d873-63ae-42de-b7bd-0ec18d897dc2 could not be found. May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'c8b7d873-63ae-42de-b7bd-0ec18d897dc2'} May 13 13:01:11.221585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c8b7d873-63ae-42de-b7bd-0ec18d897dc2 could not be found. (HTTP 404) (Request-ID: req-498041c8-9c61-4e89-8e71-6c9a1f65f0e9) May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:11.222552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:11.223784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c8b7d873-63ae-42de-b7bd-0ec18d897dc2 could not be found. May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 13:01:11.225794 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c8b7d873-63ae-42de-b7bd-0ec18d897dc2 could not be found. May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c8b7d873-63ae-42de-b7bd-0ec18d897dc2 could not be found. May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0f42651d-f984-408a-8e80-0cbc493412d2 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Returning 404 to user: Snapshot c8b7d873-63ae-42de-b7bd-0ec18d897dc2 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:11.228421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0f42651d-f984-408a-8e80-0cbc493412d2 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2" status: 404 len: 111 microversion: 2.1 time: 0.042712 May 13 13:01:11.230454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 358/739] 10.222.0.49 () {58 vars in 1250 bytes} [Fri May 13 13:01:11 2022] GET /compute/v2.1/os-snapshots/c8b7d873-63ae-42de-b7bd-0ec18d897dc2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:01:11.240493 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-37ff6ab9-063f-41ce-8d44-c3270910ae44 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601f31ee0>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:11.312528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-37ff6ab9-063f-41ce-8d44-c3270910ae44 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a" status: 202 len: 0 microversion: 2.1 time: 0.079894 May 13 13:01:11.313368 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 382/740] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 13:01:11 2022] DELETE /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:01:11.323457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-39df3cbf-4f3f-4be5-a6b9-bf3edc358f69 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601eb1ca0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:11.375912 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:11.378558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-39df3cbf-4f3f-4be5-a6b9-bf3edc358f69 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a" status: 200 len: 345 microversion: 2.1 time: 0.060004 May 13 13:01:11.379121 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 359/741] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:11 2022] GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:01:11.383700 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:11.389470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:11.390004 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:11.390921 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:11.391462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:11.406976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] HTTP exception thrown: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Request method failure captured: May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 HTTP/1.1 May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflULVlIYHu-77_74ptDCl33-OqE2cFG2ZLef-hFkiaRBVg9Wj1_oIe_IHxRmG4vdDklMFyXni9-y-Evqd3te3xn2ynCnAfHF3nDQwmYnKWresfTyiWH2VYnW0Gw8_Wi2Yh-wtkA0bpU3hSSB7AAPdx45MGAUIYEtC50wiYemq5p76BI May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:11.408901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b148a16abbc49ed816ed45fc1ad4980", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: e9eb9ff59bef4adb83fbb4c5b358280a May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:11.410540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '6707c346-88db-4146-b776-e3e370c709d5'} May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:11.411688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:11.413110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:11.414691 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Returning 404 to user: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:11.415614 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b45374cc-7fa9-4154-98de-445d998a26ea tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 404 len: 111 microversion: 2.20 time: 0.043834 May 13 13:01:11.416562 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 383/742] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:11 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 13:01:11.425554 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-63751875-a964-44cf-95fb-051bbf693baa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '.version_select at 0x7f0601ffdf70>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:11.446584 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-63751875-a964-44cf-95fb-051bbf693baa tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385620795" status: 204 len: 0 microversion: 2.20 time: 0.025835 May 13 13:01:11.449014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 360/743] 10.222.0.49 () {60 vars in 1261 bytes} [Fri May 13 13:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385620795 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:01:12.003736 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-11727c4d-8572-4e5b-8b4b-aeab9af0139f req-64a92005-339c-4f1b-9f22-4d84317fce41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6707c346-88db-4146-b776-e3e370c709d5", "name": "network-vif-deleted", "tag": "2e9af4d2-bc43-4cbb-989c-99de3b22e35f"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:12.012151 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-11727c4d-8572-4e5b-8b4b-aeab9af0139f req-64a92005-339c-4f1b-9f22-4d84317fce41 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:12.012596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-11727c4d-8572-4e5b-8b4b-aeab9af0139f req-64a92005-339c-4f1b-9f22-4d84317fce41 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:12.024165 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-11727c4d-8572-4e5b-8b4b-aeab9af0139f req-64a92005-339c-4f1b-9f22-4d84317fce41 service nova] Creating event network-vif-deleted:2e9af4d2-bc43-4cbb-989c-99de3b22e35f for instance 6707c346-88db-4146-b776-e3e370c709d5 on hv-cinder-84164 May 13 13:01:12.029264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-11727c4d-8572-4e5b-8b4b-aeab9af0139f req-64a92005-339c-4f1b-9f22-4d84317fce41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029183 May 13 13:01:12.029868 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 384/744] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:12.391659 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8e1c5bbb-9b43-458f-ac3c-ce0d2ea53559 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601f39040>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:12.419723 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-8e1c5bbb-9b43-458f-ac3c-ce0d2ea53559 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] HTTP exception thrown: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8e1c5bbb-9b43-458f-ac3c-ce0d2ea53559 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Request method failure captured: May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a HTTP/1.1 May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflaPY3Y4aVvXhRaDJeYI5wpqXL6vAVVDyDh_IDsZ0eyIEqEmqTZrDe_ayK0d9HAX92PmU43E5TiMQAMjh73vqUI2s-cC-aYufeVcO4Gjqk01LFmOMsIBP_YzwgTFiJyk-3MDt2JSEBK3ME2a-ZxyN8o3hgpqgCQTNEzR1ridBmcmkAs May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:12.421739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c63fa9b6f9e47279ad31837791098f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 306cace1ddbf4091a1b3d4a733bdecc1 May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '77bfb4d3-1141-4083-894d-e25a85b09b3a'} May 13 13:01:12.423289 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. (HTTP 404) (Request-ID: req-fc3380c4-1ffe-4ec2-a673-a08842ea68b5) May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.424599 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:12.425993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:01:12.427254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8e1c5bbb-9b43-458f-ac3c-ce0d2ea53559 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Returning 404 to user: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8e1c5bbb-9b43-458f-ac3c-ce0d2ea53559 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a" status: 404 len: 109 microversion: 2.1 time: 0.035815 May 13 13:01:12.428473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 361/745] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:12 2022] GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:01:12.437604 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7809cc9c-dbfe-4b42-b9ed-040f7dba2f35 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601f3d820>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:12.465535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-7809cc9c-dbfe-4b42-b9ed-040f7dba2f35 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] HTTP exception thrown: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7809cc9c-dbfe-4b42-b9ed-040f7dba2f35 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Request method failure captured: May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: DELETE /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a HTTP/1.1 May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflaPY3Y4aVvXhRaDJeYI5wpqXL6vAVVDyDh_IDsZ0eyIEqEmqTZrDe_ayK0d9HAX92PmU43E5TiMQAMjh73vqUI2s-cC-aYufeVcO4Gjqk01LFmOMsIBP_YzwgTFiJyk-3MDt2JSEBK3ME2a-ZxyN8o3hgpqgCQTNEzR1ridBmcmkAs May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:12.468973 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c63fa9b6f9e47279ad31837791098f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 306cace1ddbf4091a1b3d4a733bdecc1 May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '77bfb4d3-1141-4083-894d-e25a85b09b3a'} May 13 13:01:12.470623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. (HTTP 404) (Request-ID: req-3f7c5273-bd3b-4bc0-84b6-b899ae211cd1) May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.475299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:01:12.476654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:01:12.478009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7809cc9c-dbfe-4b42-b9ed-040f7dba2f35 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Returning 404 to user: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7809cc9c-dbfe-4b42-b9ed-040f7dba2f35 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a" status: 404 len: 109 microversion: 2.1 time: 0.037030 May 13 13:01:12.479316 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 385/746] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 13:01:12 2022] DELETE /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:01:12.482579 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-58e59e49-7d28-4841-baa9-7959065342b0 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Calling method '.version_select at 0x7f0601f4d700>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:12.511198 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-58e59e49-7d28-4841-baa9-7959065342b0 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] HTTP exception thrown: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-58e59e49-7d28-4841-baa9-7959065342b0 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Request method failure captured: May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a HTTP/1.1 May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflaPY3Y4aVvXhRaDJeYI5wpqXL6vAVVDyDh_IDsZ0eyIEqEmqTZrDe_ayK0d9HAX92PmU43E5TiMQAMjh73vqUI2s-cC-aYufeVcO4Gjqk01LFmOMsIBP_YzwgTFiJyk-3MDt2JSEBK3ME2a-ZxyN8o3hgpqgCQTNEzR1ridBmcmkAs May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:12.513514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c63fa9b6f9e47279ad31837791098f1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c63fa9b6f9e47279ad31837791098f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 7c63fa9b6f9e47279ad31837791098f1 May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2038688255 May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 306cace1ddbf4091a1b3d4a733bdecc1 May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2038688255-project May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '77bfb4d3-1141-4083-894d-e25a85b09b3a'} May 13 13:01:12.514855 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. (HTTP 404) (Request-ID: req-eaa359e0-60a4-45fe-a1a3-1b1e29533b5a) May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.519183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:12.520705 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:01:12.522035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-58e59e49-7d28-4841-baa9-7959065342b0 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] Returning 404 to user: Volume 77bfb4d3-1141-4083-894d-e25a85b09b3a could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-58e59e49-7d28-4841-baa9-7959065342b0 tempest-VolumesSnapshotsTestJSON-2038688255 tempest-VolumesSnapshotsTestJSON-2038688255-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a" status: 404 len: 109 microversion: 2.1 time: 0.038131 May 13 13:01:12.523139 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 362/747] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:12 2022] GET /compute/v2.1/os-volumes/77bfb4d3-1141-4083-894d-e25a85b09b3a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:01:16.454983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:16.456387 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:16.464249 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:16.464891 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:16.465965 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:16.466511 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:16.485275 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] HTTP exception thrown: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Request method failure captured: May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: DELETE /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 HTTP/1.1 May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflULVlIYHu-77_74ptDCl33-OqE2cFG2ZLef-hFkiaRBVg9Wj1_oIe_IHxRmG4vdDklMFyXni9-y-Evqd3te3xn2ynCnAfHF3nDQwmYnKWresfTyiWH2VYnW0Gw8_Wi2Yh-wtkA0bpU3hSSB7AAPdx45MGAUIYEtC50wiYemq5p76BI May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:16.489163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b148a16abbc49ed816ed45fc1ad4980", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: e9eb9ff59bef4adb83fbb4c5b358280a May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.490832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '6707c346-88db-4146-b776-e3e370c709d5'} May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:16.492067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.493526 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:16.494967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Returning 404 to user: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:16.494967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-cbaa3f71-2e41-4dca-9f70-d2c92305d5e9 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 404 len: 111 microversion: 2.20 time: 0.042094 May 13 13:01:16.502584 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:16.503403 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 6707c346-88db-4146-b776-e3e370c709d5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:16.506679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 386/748] 10.222.0.49 () {60 vars in 1279 bytes} [Fri May 13 13:01:16 2022] DELETE /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:01:16.511176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:16.511724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:16.512581 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:16.513135 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:16.527227 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] HTTP exception thrown: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Request method failure captured: May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 HTTP/1.1 May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflULVlIYHu-77_74ptDCl33-OqE2cFG2ZLef-hFkiaRBVg9Wj1_oIe_IHxRmG4vdDklMFyXni9-y-Evqd3te3xn2ynCnAfHF3nDQwmYnKWresfTyiWH2VYnW0Gw8_Wi2Yh-wtkA0bpU3hSSB7AAPdx45MGAUIYEtC50wiYemq5p76BI May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:16.528886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b148a16abbc49ed816ed45fc1ad4980", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: e9eb9ff59bef4adb83fbb4c5b358280a May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.530718 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '6707c346-88db-4146-b776-e3e370c709d5'} May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:16.531597 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. May 13 13:01:16.533726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:16.535413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Returning 404 to user: Instance 6707c346-88db-4146-b776-e3e370c709d5 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:16.535413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-136fd075-4ff1-48c3-9b95-8d1db5c8c7d2 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5" status: 404 len: 111 microversion: 2.20 time: 0.033883 May 13 13:01:16.535413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 363/749] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:16 2022] GET /compute/v2.1/servers/6707c346-88db-4146-b776-e3e370c709d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:01:17.686418 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:17.687011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:17.703965 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:17.709317 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:17.711781 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:17.715935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:17.735740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] HTTP exception thrown: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Request method failure captured: May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: DELETE /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 HTTP/1.1 May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflULVlIYHu-77_74ptDCl33-OqE2cFG2ZLef-hFkiaRBVg9Wj1_oIe_IHxRmG4vdDklMFyXni9-y-Evqd3te3xn2ynCnAfHF3nDQwmYnKWresfTyiWH2VYnW0Gw8_Wi2Yh-wtkA0bpU3hSSB7AAPdx45MGAUIYEtC50wiYemq5p76BI May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:17.738533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b148a16abbc49ed816ed45fc1ad4980", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: e9eb9ff59bef4adb83fbb4c5b358280a May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.742690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '83873f65-ba42-4536-9af6-4aff1db77bb4'} May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:17.743992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.745790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:17.747829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Returning 404 to user: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:17.747829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-274a03fc-0a64-4d77-af93-d3831d67d558 tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "DELETE /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 404 len: 111 microversion: 2.20 time: 0.059790 May 13 13:01:17.747829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 387/750] 10.222.0.49 () {60 vars in 1279 bytes} [Fri May 13 13:01:17 2022] DELETE /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:01:17.758828 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:17.759669 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] [instance: 83873f65-ba42-4536-9af6-4aff1db77bb4] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:17.766907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:17.767362 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:17.768903 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:17.769734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:17.786533 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] HTTP exception thrown: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Request method failure captured: May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 HTTP/1.1 May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflULVlIYHu-77_74ptDCl33-OqE2cFG2ZLef-hFkiaRBVg9Wj1_oIe_IHxRmG4vdDklMFyXni9-y-Evqd3te3xn2ynCnAfHF3nDQwmYnKWresfTyiWH2VYnW0Gw8_Wi2Yh-wtkA0bpU3hSSB7AAPdx45MGAUIYEtC50wiYemq5p76BI May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:17.788175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b148a16abbc49ed816ed45fc1ad4980", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b148a16abbc49ed816ed45fc1ad4980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 0b148a16abbc49ed816ed45fc1ad4980 May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-181270742 May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: e9eb9ff59bef4adb83fbb4c5b358280a May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-181270742-project May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.789729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '83873f65-ba42-4536-9af6-4aff1db77bb4'} May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:17.795474 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. May 13 13:01:17.798066 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:17.800827 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] Returning 404 to user: Instance 83873f65-ba42-4536-9af6-4aff1db77bb4 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:17.800827 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0a02614f-1603-49ba-9ef1-df9b3358237c tempest-AttachVolumeShelveTestJSON-181270742 tempest-AttachVolumeShelveTestJSON-181270742-project] 10.222.0.49 "GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4" status: 404 len: 111 microversion: 2.20 time: 0.035845 May 13 13:01:17.800827 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 364/751] 10.222.0.49 () {60 vars in 1276 bytes} [Fri May 13 13:01:17 2022] GET /compute/v2.1/servers/83873f65-ba42-4536-9af6-4aff1db77bb4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:01:25.888589 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8053145a-6f8a-49e8-b4b6-10073ccc9f7a tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Action: 'create', calling method: .version_select at 0x7f0601ebf790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-936922533", "metadata": {"Type": "work"}}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8053145a-6f8a-49e8-b4b6-10073ccc9f7a tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Request method failure captured: May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 121 May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflalMs1zaZLrMqPb0TZksXgWjWPTyDCIXg01F7PG1hQU0T-zpd4yfrHXX_gPpoKs9Isf83CKLJogKXjRVcugs8iTA2yrKGNc2u1DlxxyrrLFsC3s_-gACA2HOhU1tnXqNxBD_FGPVsPire40DT-7Gz42U5LyfkWbbK8qpQNkUFrN3x4 May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:25.897920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eddf97c9b78a449cbdb62eb76db2c822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: ec9a2bacc3a64705b84a0339fd1af5dd May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-936922533", "metadata": {"Type": "work"}}} May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: May 13 13:01:25.900102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-936922533', 'metadata': {'Type': 'work'}}}} May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise error May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi '#$%' May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:25.901767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:01:25.903495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:01:25.905381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:01:25.905381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.905381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8053145a-6f8a-49e8-b4b6-10073ccc9f7a tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:25.905381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8053145a-6f8a-49e8-b4b6-10073ccc9f7a tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.449694 May 13 13:01:25.905381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 388/752] 10.222.0.49 () {60 vars in 1155 bytes} [Fri May 13 13:01:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 455 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 13:01:25.910856 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c3bc5c0c-e6b4-4a96-9009-f9a5fe61cf86 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Action: 'create', calling method: .version_select at 0x7f0601f44c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-917583762", "metadata": {"Type": "work"}}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c3bc5c0c-e6b4-4a96-9009-f9a5fe61cf86 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Request method failure captured: May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 119 May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflalMs1zaZLrMqPb0TZksXgWjWPTyDCIXg01F7PG1hQU0T-zpd4yfrHXX_gPpoKs9Isf83CKLJogKXjRVcugs8iTA2yrKGNc2u1DlxxyrrLFsC3s_-gACA2HOhU1tnXqNxBD_FGPVsPire40DT-7Gz42U5LyfkWbbK8qpQNkUFrN3x4 May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:25.915460 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eddf97c9b78a449cbdb62eb76db2c822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: ec9a2bacc3a64705b84a0339fd1af5dd May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-917583762", "metadata": {"Type": "work"}}} May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: May 13 13:01:25.917047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-917583762', 'metadata': {'Type': 'work'}}}} May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise error May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi '0' May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:25.918064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:01:25.919529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:01:25.920852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:01:25.920852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.920852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c3bc5c0c-e6b4-4a96-9009-f9a5fe61cf86 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:25.920852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c3bc5c0c-e6b4-4a96-9009-f9a5fe61cf86 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012505 May 13 13:01:25.920852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 365/753] 10.222.0.49 () {60 vars in 1155 bytes} [Fri May 13 13:01:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 13:01:25.930899 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3eeccb45-9ee3-46a8-bdc9-c6c01b0ec23d tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Action: 'create', calling method: .version_select at 0x7f0601ebb9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-467043662", "metadata": {"Type": "work"}}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3eeccb45-9ee3-46a8-bdc9-c6c01b0ec23d tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Request method failure captured: May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 118 May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflalMs1zaZLrMqPb0TZksXgWjWPTyDCIXg01F7PG1hQU0T-zpd4yfrHXX_gPpoKs9Isf83CKLJogKXjRVcugs8iTA2yrKGNc2u1DlxxyrrLFsC3s_-gACA2HOhU1tnXqNxBD_FGPVsPire40DT-7Gz42U5LyfkWbbK8qpQNkUFrN3x4 May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:25.934956 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eddf97c9b78a449cbdb62eb76db2c822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: ec9a2bacc3a64705b84a0339fd1af5dd May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-467043662", "metadata": {"Type": "work"}}} May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: May 13 13:01:25.937228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-467043662', 'metadata': {'Type': 'work'}}}} May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise error May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi '' May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:25.938519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:01:25.941280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:01:25.942704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:01:25.942704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:25.942704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3eeccb45-9ee3-46a8-bdc9-c6c01b0ec23d tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:25.942704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3eeccb45-9ee3-46a8-bdc9-c6c01b0ec23d tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009888 May 13 13:01:25.942704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 389/754] 10.222.0.49 () {60 vars in 1155 bytes} [Fri May 13 13:01:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 13:01:25.949455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0bb98cb9-29ae-4280-817f-1a11a151f386 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Calling method '.version_select at 0x7f0601e8b8b0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:25.983107 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-0bb98cb9-29ae-4280-817f-1a11a151f386 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] HTTP exception thrown: Volume tempest-invalid-1232901647 could not be found. May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0bb98cb9-29ae-4280-817f-1a11a151f386 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Request method failure captured: May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1232901647 HTTP/1.1 May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflalMs1zaZLrMqPb0TZksXgWjWPTyDCIXg01F7PG1hQU0T-zpd4yfrHXX_gPpoKs9Isf83CKLJogKXjRVcugs8iTA2yrKGNc2u1DlxxyrrLFsC3s_-gACA2HOhU1tnXqNxBD_FGPVsPire40DT-7Gz42U5LyfkWbbK8qpQNkUFrN3x4 May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:25.985395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eddf97c9b78a449cbdb62eb76db2c822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: ec9a2bacc3a64705b84a0339fd1af5dd May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesNegativeTest-796240244-project May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Volume tempest-invalid-1232901647 could not be found. May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'tempest-invalid-1232901647'} May 13 13:01:25.986964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1232901647 could not be found. (HTTP 404) (Request-ID: req-140774d1-e8fa-4533-80cf-b92a6f9d19b0) May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.987911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:01:25.995396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1232901647 could not be found. May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:25.996739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1232901647 could not be found. May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1232901647 could not be found. May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0bb98cb9-29ae-4280-817f-1a11a151f386 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Returning 404 to user: Volume tempest-invalid-1232901647 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0bb98cb9-29ae-4280-817f-1a11a151f386 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1232901647" status: 404 len: 99 microversion: 2.1 time: 0.042314 May 13 13:01:25.998184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 366/755] 10.222.0.49 () {58 vars in 1217 bytes} [Fri May 13 13:01:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1232901647 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 13 13:01:26.005446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c49e1fb5-0104-406c-b185-ddaf6b476335 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010702 May 13 13:01:26.007017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 390/756] 10.222.0.49 () {58 vars in 1139 bytes} [Fri May 13 13:01:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 13:01:26.015577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-00c2e00a-c3be-41ca-953f-9c85b9cc3d4a tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003744 May 13 13:01:26.016085 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 367/757] 10.222.0.49 () {58 vars in 1136 bytes} [Fri May 13 13:01:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 13:01:26.027177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0e7add2a-d24c-40dd-a8a8-bb81ced98bf2 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Calling method '.version_select at 0x7f0601ebf790>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:26.070925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-0e7add2a-d24c-40dd-a8a8-bb81ced98bf2 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] HTTP exception thrown: Volume a505ec85-e0de-4aa5-8c23-586d25b6d360 could not be found. May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0e7add2a-d24c-40dd-a8a8-bb81ced98bf2 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Request method failure captured: May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: DELETE /compute/v2.1/os-volumes/a505ec85-e0de-4aa5-8c23-586d25b6d360 HTTP/1.1 May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflalMs1zaZLrMqPb0TZksXgWjWPTyDCIXg01F7PG1hQU0T-zpd4yfrHXX_gPpoKs9Isf83CKLJogKXjRVcugs8iTA2yrKGNc2u1DlxxyrrLFsC3s_-gACA2HOhU1tnXqNxBD_FGPVsPire40DT-7Gz42U5LyfkWbbK8qpQNkUFrN3x4 May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:01:26.073196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eddf97c9b78a449cbdb62eb76db2c822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-VolumesNegativeTest-796240244 May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-VolumesNegativeTest-796240244-project May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: ec9a2bacc3a64705b84a0339fd1af5dd May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-VolumesNegativeTest-796240244-project May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Volume a505ec85-e0de-4aa5-8c23-586d25b6d360 could not be found. May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': 'a505ec85-e0de-4aa5-8c23-586d25b6d360'} May 13 13:01:26.074843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a505ec85-e0de-4aa5-8c23-586d25b6d360 could not be found. (HTTP 404) (Request-ID: req-276ac14b-e65b-4426-b053-321fc37f6f06) May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:26.075804 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:01:26.077124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a505ec85-e0de-4aa5-8c23-586d25b6d360 could not be found. May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:01:26.078470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a505ec85-e0de-4aa5-8c23-586d25b6d360 could not be found. May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a505ec85-e0de-4aa5-8c23-586d25b6d360 could not be found. May 13 13:01:26.079779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:01:26.085014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0e7add2a-d24c-40dd-a8a8-bb81ced98bf2 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Returning 404 to user: Volume a505ec85-e0de-4aa5-8c23-586d25b6d360 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:26.086226 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0e7add2a-d24c-40dd-a8a8-bb81ced98bf2 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/a505ec85-e0de-4aa5-8c23-586d25b6d360" status: 404 len: 109 microversion: 2.1 time: 0.064293 May 13 13:01:26.087073 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 391/758] 10.222.0.49 () {58 vars in 1247 bytes} [Fri May 13 13:01:26 2022] DELETE /compute/v2.1/os-volumes/a505ec85-e0de-4aa5-8c23-586d25b6d360 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:01:26.100347 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-09eccb85-0f6f-45ee-b6c3-41d815b27b58 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Calling method '.version_select at 0x7f0601ee9700>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:26.151051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-09eccb85-0f6f-45ee-b6c3-41d815b27b58 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] HTTP exception thrown: Volume 4c2f837c-b0ef-45ea-8189-1fcb63772762 could not be found. May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-09eccb85-0f6f-45ee-b6c3-41d815b27b58 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Request method failure captured: May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/os-volumes/4c2f837c-b0ef-45ea-8189-1fcb63772762 HTTP/1.1 May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflalMs1zaZLrMqPb0TZksXgWjWPTyDCIXg01F7PG1hQU0T-zpd4yfrHXX_gPpoKs9Isf83CKLJogKXjRVcugs8iTA2yrKGNc2u1DlxxyrrLFsC3s_-gACA2HOhU1tnXqNxBD_FGPVsPire40DT-7Gz42U5LyfkWbbK8qpQNkUFrN3x4 May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:26.153491 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_eddf97c9b78a449cbdb62eb76db2c822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/eddf97c9b78a449cbdb62eb76db2c822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesNegativeTest-796240244 May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: eddf97c9b78a449cbdb62eb76db2c822 May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesNegativeTest-796240244 May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesNegativeTest-796240244-project May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: ec9a2bacc3a64705b84a0339fd1af5dd May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesNegativeTest-796240244-project May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Volume 4c2f837c-b0ef-45ea-8189-1fcb63772762 could not be found. May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '4c2f837c-b0ef-45ea-8189-1fcb63772762'} May 13 13:01:26.155065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c2f837c-b0ef-45ea-8189-1fcb63772762 could not be found. (HTTP 404) (Request-ID: req-35c86b01-3f73-40a0-819c-a5a69ca678ae) May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:26.156051 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:01:26.157481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c2f837c-b0ef-45ea-8189-1fcb63772762 could not be found. May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:01:26.158789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c2f837c-b0ef-45ea-8189-1fcb63772762 could not be found. May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c2f837c-b0ef-45ea-8189-1fcb63772762 could not be found. May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-09eccb85-0f6f-45ee-b6c3-41d815b27b58 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] Returning 404 to user: Volume 4c2f837c-b0ef-45ea-8189-1fcb63772762 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:26.159909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-09eccb85-0f6f-45ee-b6c3-41d815b27b58 tempest-VolumesNegativeTest-796240244 tempest-VolumesNegativeTest-796240244-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4c2f837c-b0ef-45ea-8189-1fcb63772762" status: 404 len: 109 microversion: 2.1 time: 0.060793 May 13 13:01:26.166273 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 368/759] 10.222.0.49 () {58 vars in 1244 bytes} [Fri May 13 13:01:26 2022] GET /compute/v2.1/os-volumes/4c2f837c-b0ef-45ea-8189-1fcb63772762 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:01:28.054908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1937503553", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:28.130832 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] validate_networks() for None {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:01:28.491256 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:01:28.491698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:01:28.492332 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:01:28.492772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:01:28.493216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:01:28.504024 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:28.505472 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:28.506814 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:28.507437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:28.526052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Getting quotas for project 84550eda091c4103a878c99351c26ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:01:28.531501 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Getting quotas for user 45a19d04c3ef4294817b317f59c96055 and project 84550eda091c4103a878c99351c26ce4. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:01:28.544777 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:01:28.547333 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:01:28.626805 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-821d1e3d-12a3-4608-9873-cd2bed75d9c8 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575536 May 13 13:01:28.640060 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-38962366-c0ca-41ed-a44d-3d2d05bc379f tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:28.641333 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-38962366-c0ca-41ed-a44d-3d2d05bc379f tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:28.644448 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 392/760] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:01:28.727449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-38962366-c0ca-41ed-a44d-3d2d05bc379f tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:28.735905 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-38962366-c0ca-41ed-a44d-3d2d05bc379f tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1215 microversion: 2.1 time: 0.101123 May 13 13:01:28.737719 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 369/761] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:28 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:29.755860 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:29.756471 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:29.764834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:29.765545 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:29.766530 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:29.767195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:29.834598 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:29.843495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6b4611c5-4899-4292-a1ea-4d636bf6c267 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1267 microversion: 2.1 time: 0.093251 May 13 13:01:29.854695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 393/762] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:29 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:30.862857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:30.864478 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:30.871966 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:30.872769 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:30.873861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:30.874534 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:30.960420 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:30.969330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ad5724f6-9156-4f4e-8247-7928e8cd4571 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1273 microversion: 2.1 time: 0.111597 May 13 13:01:30.969908 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 370/763] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:30 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:31.997942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:32.000506 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:32.017267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:32.018622 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:32.020027 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:32.020622 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:32.207989 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:32.217964 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-17f8df08-fb5a-4086-a5b1-c20d647a9378 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1315 microversion: 2.1 time: 0.233556 May 13 13:01:32.227469 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 394/764] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:31 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:32.436216 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-b7a51f27-ffab-446f-bc64-39ac8b905f5d req-19b2f798-be45-42b9-a85c-9f61a54f5f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d84435-e8e4-433e-8784-0cf07d8e25f6", "tag": "0b85bb5e-82bb-40a9-91f5-5b14bddd789c"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:32.447857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-b7a51f27-ffab-446f-bc64-39ac8b905f5d req-19b2f798-be45-42b9-a85c-9f61a54f5f70 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:32.448647 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-b7a51f27-ffab-446f-bc64-39ac8b905f5d req-19b2f798-be45-42b9-a85c-9f61a54f5f70 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:32.464686 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-b7a51f27-ffab-446f-bc64-39ac8b905f5d req-19b2f798-be45-42b9-a85c-9f61a54f5f70 service nova] Creating event network-changed:0b85bb5e-82bb-40a9-91f5-5b14bddd789c for instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 on hv-cinder-84164 May 13 13:01:32.470515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-b7a51f27-ffab-446f-bc64-39ac8b905f5d req-19b2f798-be45-42b9-a85c-9f61a54f5f70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040579 May 13 13:01:32.478331 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 371/765] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:33.235447 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:33.235911 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:33.242953 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:33.243407 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:33.244182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:33.247849 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:33.432640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:33.441925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a9703679-0326-44da-a200-e224283aad86 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1315 microversion: 2.1 time: 0.210581 May 13 13:01:33.442809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 395/766] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:33 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:34.462744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:34.463967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:34.480033 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:34.480866 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:34.482135 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:34.482779 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:34.694388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:34.714440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1e985570-730e-4bc1-95c0-4e97ae9cd330 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1315 microversion: 2.1 time: 0.258733 May 13 13:01:34.717943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 372/767] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:34 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:35.736789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:35.737508 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:35.749079 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:35.754008 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:35.755016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:35.757756 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:36.092164 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:36.102687 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-69a88853-e3e8-485b-89ce-e364d13b532e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1315 microversion: 2.1 time: 0.369622 May 13 13:01:36.103682 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 396/768] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:35 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:37.119687 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:37.120439 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:37.129678 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:37.130338 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:37.131283 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:37.131734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:37.335398 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:37.345977 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c49c74d8-f8ca-4542-9d72-46f5e5b5a97c tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1315 microversion: 2.1 time: 0.230114 May 13 13:01:37.348272 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 373/769] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:37 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:38.018943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-4d9e71a7-6460-4977-b664-2560fc6a8def req-c8d96266-0028-445c-b74d-83885e53505a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d84435-e8e4-433e-8784-0cf07d8e25f6", "name": "network-vif-plugged", "status": "completed", "tag": "0b85bb5e-82bb-40a9-91f5-5b14bddd789c"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:38.043905 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-4d9e71a7-6460-4977-b664-2560fc6a8def req-c8d96266-0028-445c-b74d-83885e53505a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:38.046911 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-4d9e71a7-6460-4977-b664-2560fc6a8def req-c8d96266-0028-445c-b74d-83885e53505a service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:38.077094 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-4d9e71a7-6460-4977-b664-2560fc6a8def req-c8d96266-0028-445c-b74d-83885e53505a service nova] Creating event network-vif-plugged:0b85bb5e-82bb-40a9-91f5-5b14bddd789c for instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 on hv-cinder-84164 May 13 13:01:38.087306 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-4d9e71a7-6460-4977-b664-2560fc6a8def req-c8d96266-0028-445c-b74d-83885e53505a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073799 May 13 13:01:38.088692 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 397/770] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:38.364644 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:38.366046 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:38.373059 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:38.373571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:38.374566 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:38.375023 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:38.556355 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:38.563646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-36f55590-a96b-40f2-b177-0b7f4f80601e tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1315 microversion: 2.1 time: 0.204214 May 13 13:01:38.564214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 374/771] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:38 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:39.582015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:39.582724 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:39.589626 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:39.590085 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:39.590877 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:39.591379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:39.727462 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:39.735214 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e6fdc192-d907-4cfb-a4d1-3409f25d8b04 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1315 microversion: 2.1 time: 0.157927 May 13 13:01:39.735788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 398/772] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:39 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:40.751833 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:40.752449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:40.758700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:40.759154 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:40.759979 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:40.760451 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:40.890210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:40.898486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6ea3c65a-cb84-4408-87e2-75ae22f44a1d tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1464 microversion: 2.1 time: 0.150514 May 13 13:01:40.899062 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 375/773] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:40 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:40.936770 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:40.937339 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:40.944060 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:40.944507 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:40.945298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:40.945735 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:40.975315 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:01:41.055975 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8f7688a1-7ac0-498a-a8df-be0b5b0496f1 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "DELETE /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 204 len: 0 microversion: 2.1 time: 0.122547 May 13 13:01:41.056812 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 399/774] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:01:40 2022] DELETE /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:01:41.066156 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:41.066871 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:41.073165 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:41.073624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:41.074403 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:41.074839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:41.220638 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:41.228664 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2e1eb49b-3e67-4d06-ab8e-46eef0f4c405 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1470 microversion: 2.1 time: 0.167148 May 13 13:01:41.229255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 376/775] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:41 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:42.248451 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:42.249836 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:42.257303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:42.258077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:42.259107 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:42.259614 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:42.428433 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:42.438652 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e5c4e54f-a96a-455a-bbbd-c2324c514576 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1470 microversion: 2.1 time: 0.195427 May 13 13:01:42.440325 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 400/776] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:42 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:43.305416 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-719a09e4-14d9-4c28-830e-2abb8414d424 req-60571a9d-00eb-4146-9f89-b0fb49d3129f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d84435-e8e4-433e-8784-0cf07d8e25f6", "name": "network-vif-deleted", "tag": "0b85bb5e-82bb-40a9-91f5-5b14bddd789c"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:43.319615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-719a09e4-14d9-4c28-830e-2abb8414d424 req-60571a9d-00eb-4146-9f89-b0fb49d3129f service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:43.320201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-719a09e4-14d9-4c28-830e-2abb8414d424 req-60571a9d-00eb-4146-9f89-b0fb49d3129f service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:43.353022 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-719a09e4-14d9-4c28-830e-2abb8414d424 req-60571a9d-00eb-4146-9f89-b0fb49d3129f service nova] Creating event network-vif-deleted:0b85bb5e-82bb-40a9-91f5-5b14bddd789c for instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 on hv-cinder-84164 May 13 13:01:43.365094 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-719a09e4-14d9-4c28-830e-2abb8414d424 req-60571a9d-00eb-4146-9f89-b0fb49d3129f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062420 May 13 13:01:43.366365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 377/777] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:43.459155 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:43.460528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:43.467612 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:43.468554 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:43.469662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:43.470182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:43.506788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:43.507333 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:43.507795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lazy-loading 'fault' on Instance uuid 90d84435-e8e4-433e-8784-0cf07d8e25f6 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:01:43.560570 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45a19d04c3ef4294817b317f59c96055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84550eda091c4103a878c99351c26ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:43.569858 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-52866fda-b4a8-4c6c-87ab-d59e0b412e87 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 200 len: 1305 microversion: 2.1 time: 0.116735 May 13 13:01:43.570798 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 401/778] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:43 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:44.587983 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:44.588682 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] [instance: 90d84435-e8e4-433e-8784-0cf07d8e25f6] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:44.594683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:44.595136 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:44.595913 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:44.596359 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:44.609306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] HTTP exception thrown: Instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 could not be found. May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Request method failure captured: May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 HTTP/1.1 May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflam60B3sEjYKgGeDzyjS_AO-WgnNcC2HJCcKiOdnnEqIWcUukj8fTdSWcusIZTN1csnRWQPZHsvp0Nsi2p6OQ3Vgb7S6om5HZAhBdBgNrzNt_zMbWdcW-u6EyJNHWHSzEIDUk7BYkreuPod6qMi1QwvyrmvwjH4-OUSj0N7kM3NKVs May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 84550eda091c4103a878c99351c26ce4 May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-VolumesNegativeTest-47631797 May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:01:44.610922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84550eda091c4103a878c99351c26ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84550eda091c4103a878c99351c26ce4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84550eda091c4103a878c99351c26ce4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84550eda091c4103a878c99351c26ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-VolumesNegativeTest-47631797 May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 84550eda091c4103a878c99351c26ce4 May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-VolumesNegativeTest-47631797 May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-VolumesNegativeTest-47631797-project May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 45a19d04c3ef4294817b317f59c96055 May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-VolumesNegativeTest-47631797-project May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 could not be found. May 13 13:01:44.613147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '90d84435-e8e4-433e-8784-0cf07d8e25f6'} May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 could not be found. May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:01:44.614108 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 could not be found. May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 could not be found. May 13 13:01:44.615309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:01:44.616367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] Returning 404 to user: Instance 90d84435-e8e4-433e-8784-0cf07d8e25f6 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:01:44.616367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5b791a56-f45a-487e-bef6-91c5530b8142 tempest-VolumesNegativeTest-47631797 tempest-VolumesNegativeTest-47631797-project] 10.222.0.49 "GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6" status: 404 len: 111 microversion: 2.1 time: 0.029114 May 13 13:01:44.616367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 378/779] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:44 2022] GET /compute/v2.1/servers/90d84435-e8e4-433e-8784-0cf07d8e25f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:01:53.139442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1975831643", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "networks": [{"uuid": "9564931c-c5b5-4379-ab8f-8be704e0bc3e"}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:53.195772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] validate_networks() for [('9564931c-c5b5-4379-ab8f-8be704e0bc3e', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:01:53.543520 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:01:53.543944 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:01:53.544416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:01:53.544823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:01:53.545272 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:01:53.554239 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:53.554684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:53.555663 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:53.556155 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:53.574782 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Getting quotas for project c04aaf2b58354e1992d66c09f5f562ad. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:01:53.578696 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Getting quotas for user 7410940d292d436d9adb0421144d8af3 and project c04aaf2b58354e1992d66c09f5f562ad. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:01:53.589339 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:01:53.591596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:01:53.638443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d06fa065-a7f0-4288-bdad-21ba41ba5261 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503377 May 13 13:01:53.639092 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 402/780] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:01:53.649810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-e7814b9b-c927-416e-a098-8ddb3b5b1f6f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:53.650435 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-e7814b9b-c927-416e-a098-8ddb3b5b1f6f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:53.706250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-e7814b9b-c927-416e-a098-8ddb3b5b1f6f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:53.713172 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-e7814b9b-c927-416e-a098-8ddb3b5b1f6f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1219 microversion: 2.1 time: 0.067945 May 13 13:01:53.713748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 379/781] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:53 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:54.730637 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:54.731182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:54.737368 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:54.737824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:54.738638 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:54.739082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:54.802216 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:54.809362 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a745172d-7350-4303-ad44-58a65e0fdb8c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1223 microversion: 2.1 time: 0.083159 May 13 13:01:54.809936 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 403/782] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:54 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:55.826559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:55.827167 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:55.834727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:55.835173 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:55.835935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:55.836374 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:55.896276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:55.904165 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-de0db211-da2b-451e-ab71-8049e5eee42e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1223 microversion: 2.1 time: 0.081518 May 13 13:01:55.904731 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 380/783] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:55 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:56.920950 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:56.921592 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:56.928143 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:56.928625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:56.929456 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:56.929903 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:56.993067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:57.000514 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f4ed4b7f-7421-4085-82ad-1b0ee62e8f9f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1277 microversion: 2.1 time: 0.083405 May 13 13:01:57.001110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 404/784] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:56 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:57.967998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-05b97408-7282-45ab-b9a6-f5a840aadf02 req-3f4c8786-6a57-43af-8069-0a1a421ad616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287d423f-698a-400e-9798-80bcaf60cc1b", "tag": "dcd85070-3bae-40b6-8131-30f8c785f8e8"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:01:57.977190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-05b97408-7282-45ab-b9a6-f5a840aadf02 req-3f4c8786-6a57-43af-8069-0a1a421ad616 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:57.977743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-05b97408-7282-45ab-b9a6-f5a840aadf02 req-3f4c8786-6a57-43af-8069-0a1a421ad616 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:57.989253 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-05b97408-7282-45ab-b9a6-f5a840aadf02 req-3f4c8786-6a57-43af-8069-0a1a421ad616 service nova] Creating event network-changed:dcd85070-3bae-40b6-8131-30f8c785f8e8 for instance 287d423f-698a-400e-9798-80bcaf60cc1b on hv-cinder-84164 May 13 13:01:57.994024 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-05b97408-7282-45ab-b9a6-f5a840aadf02 req-3f4c8786-6a57-43af-8069-0a1a421ad616 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029855 May 13 13:01:57.994624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 381/785] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:01:58.016908 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:58.017555 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:58.024009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:58.024455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:58.025267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:58.025734 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:58.154039 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:58.161498 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-91734413-c5cf-4935-bcbe-83259985240e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.148432 May 13 13:01:58.162065 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 405/786] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:58 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:01:59.179214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:01:59.179927 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:01:59.186117 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:59.186576 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:59.187354 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:01:59.187802 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:01:59.318141 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:01:59.325543 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-29e34c28-29c3-4d80-b487-b2b2eadb76cf tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.150967 May 13 13:01:59.326153 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 382/787] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:01:59 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:00.343231 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:00.343749 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:00.350044 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:00.350499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:00.351263 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:00.351696 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:00.477524 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:00.484853 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a7347016-0318-423d-b12c-22ea1a9ceb91 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.145488 May 13 13:02:00.485460 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 406/788] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:00 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:01.501933 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:01.502525 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:01.509561 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:01.510013 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:01.510784 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:01.511227 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:01.690217 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:01.698120 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-12dbb831-0317-4355-a328-b99f1c479dd4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.199956 May 13 13:02:01.698687 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 383/789] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:01 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:02.714299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:02.714910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:02.721193 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:02.721643 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:02.722400 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:02.722833 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:02.865794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:02.873133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-acc50734-142e-4035-98f9-f62a4815d5f0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.162540 May 13 13:02:02.873704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 407/790] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:02 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:03.890313 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:03.890929 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:03.897993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:03.898449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:03.899219 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:03.899659 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:04.046693 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:04.054183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-11778f6e-21e1-4d1d-b9a3-9ae2ef17e258 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.167693 May 13 13:02:04.054759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 384/791] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:03 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:05.070852 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:05.071469 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:05.077677 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:05.078123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:05.078886 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:05.079321 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:05.209876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:05.217149 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-158263ac-a2c4-4a6c-8c77-b58a70ed313b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.150627 May 13 13:02:05.217718 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 408/792] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:05 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:06.234423 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:06.235315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:06.243243 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:06.243830 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:06.244756 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:06.245452 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:06.407401 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:06.416221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-19aec6dd-3bff-4e79-88b8-85900617944f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.185619 May 13 13:02:06.417021 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 385/793] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:06 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:07.433270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:07.433911 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:07.440840 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:07.441723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:07.443038 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:07.443843 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:07.585548 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:07.593210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-33530f64-f693-407b-b578-49f2e665fe24 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.163774 May 13 13:02:07.593790 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 409/794] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:07 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:08.609862 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:08.610480 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:08.617346 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:08.617796 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:08.618565 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:08.619009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:08.749219 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:08.756440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6f1bd1d3-26ec-4ac1-9131-5d86aea5502c tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.150416 May 13 13:02:08.757023 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 386/795] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:08 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:09.773008 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:09.773636 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:09.780152 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:09.780662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:09.781767 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:09.782381 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:09.920836 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:09.928237 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4e29337f-22aa-4c23-ad79-53b62ae73a36 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.159031 May 13 13:02:09.928925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 410/796] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:09 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:10.217034 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-326a7d6d-3243-4bec-b17c-94f71f629537 req-4e540e5e-aa39-4e1b-b359-cecf32757cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287d423f-698a-400e-9798-80bcaf60cc1b", "name": "network-vif-plugged", "status": "completed", "tag": "dcd85070-3bae-40b6-8131-30f8c785f8e8"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:02:10.226150 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-326a7d6d-3243-4bec-b17c-94f71f629537 req-4e540e5e-aa39-4e1b-b359-cecf32757cfa service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:10.226610 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-326a7d6d-3243-4bec-b17c-94f71f629537 req-4e540e5e-aa39-4e1b-b359-cecf32757cfa service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:10.237469 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-326a7d6d-3243-4bec-b17c-94f71f629537 req-4e540e5e-aa39-4e1b-b359-cecf32757cfa service nova] Creating event network-vif-plugged:dcd85070-3bae-40b6-8131-30f8c785f8e8 for instance 287d423f-698a-400e-9798-80bcaf60cc1b on hv-cinder-84164 May 13 13:02:10.242925 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-326a7d6d-3243-4bec-b17c-94f71f629537 req-4e540e5e-aa39-4e1b-b359-cecf32757cfa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029766 May 13 13:02:10.243514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 387/797] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:02:10.945129 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:10.945781 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:10.952155 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:10.952608 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:10.953409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:10.953867 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:11.085383 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:11.092852 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6f2dacc9-e0db-4055-b3d4-70513ffeea3e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.152163 May 13 13:02:11.093455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 411/798] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:10 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:12.110522 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:12.111142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:12.117667 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:12.118114 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:12.118876 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:12.119314 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:12.250850 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:12.258719 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8546a332-7a36-4f8d-a617-e62723641334 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.152886 May 13 13:02:12.259385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 388/799] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:12 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:13.275477 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:13.276043 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:13.282542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:13.282993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:13.283757 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:13.284192 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:13.420993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:13.428831 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-bd5b5dd0-a0e1-48a3-82c9-fcc3a967590e tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.157230 May 13 13:02:13.429434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 412/800] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:13 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:14.445319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:14.445943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:14.452274 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:14.452734 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:14.453537 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:14.454014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:14.581799 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:14.589658 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8c4c6c6c-a1fc-421f-b0aa-4cec3103e80d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1319 microversion: 2.1 time: 0.148404 May 13 13:02:14.590225 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 389/801] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:14 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:15.606041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:15.606691 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:15.613082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:15.613540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:15.614331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:15.614878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:15.742651 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:15.749892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-aa4614d5-2f0a-41b9-98cd-e44ebaff3e7f tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1509 microversion: 2.1 time: 0.147760 May 13 13:02:15.750460 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 413/802] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:15 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:25.737166 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:02:25.738184 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Fri May 13 13:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:02:32.145466 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0498c9dd-83bf-4011-a590-2724b313cc06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cceaa64-a833-45e7-a1e6-050126b5199d", "device": "/dev/sdb"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:02:32.147105 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0498c9dd-83bf-4011-a590-2724b313cc06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:32.158059 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0498c9dd-83bf-4011-a590-2724b313cc06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:32.158515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0498c9dd-83bf-4011-a590-2724b313cc06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:32.159310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0498c9dd-83bf-4011-a590-2724b313cc06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:32.159756 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0498c9dd-83bf-4011-a590-2724b313cc06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:32.671261 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0498c9dd-83bf-4011-a590-2724b313cc06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "POST /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535193 May 13 13:02:32.672296 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 390/803] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 13:02:32 2022] POST /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:02:39.289752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-79488d7d-1762-4869-b585-35104c07e0e7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Action: 'create', calling method: .version_select at 0x7f0601f31e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1219736643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw6jgCRmf9khKHxVYHUJlyBuDpjC5Gr4lFhlYiQF58caExVQjA6U1qEC81nT2n2QuyYQ2VJXSubAzrbnWaiAPY6oAdmCRBBc+rp9aS2Q1xehNF6oZ6k8EF+o/U3r/BYfA=="}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:02:39.312492 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-79488d7d-1762-4869-b585-35104c07e0e7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:02:39.334298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-79488d7d-1762-4869-b585-35104c07e0e7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for user 0956067c32cd476a8db7ee074f210700 and project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:02:39.397091 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-79488d7d-1762-4869-b585-35104c07e0e7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.376360 May 13 13:02:39.397932 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 414/804] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 13:02:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:02:52.395292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cdb2b305-9696-4944-9da1-6e2c96aceec9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Action: 'create', calling method: .version_select at 0x7f0601ea0160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-965017868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMncSl4SpBdkNgu74KxEg/x3lCx7HwqiGFDwpD6PTNDMYtc5/C8E1l6ZVwO7VcoBMsbELDC9ZI3QNbRT61VwS31wJ607n/vL9QyjSlaMsIekEJxuSnRKterN40R9IIVuFw=="}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:02:52.410762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-cdb2b305-9696-4944-9da1-6e2c96aceec9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Getting quotas for project f7713dfabbe6446fac28d0b194ca627a. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:02:52.416743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-cdb2b305-9696-4944-9da1-6e2c96aceec9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Getting quotas for user 98724cc2db0e4404bbc71b3ae864ecfa and project f7713dfabbe6446fac28d0b194ca627a. Resources: {'key_pairs'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:02:52.439001 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cdb2b305-9696-4944-9da1-6e2c96aceec9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048370 May 13 13:02:52.439609 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 391/805] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 13:02:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:02:52.487649 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-702996808", "imageRef": "74b56e12-6dd0-456a-8625-2a4ebba692d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-965017868", "networks": [{"uuid": "ab26390c-2249-42bd-97a1-5fb2c028b74a"}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:02:52.536208 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] validate_networks() for [('ab26390c-2249-42bd-97a1-5fb2c028b74a', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:02:52.950067 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:02:52.950565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:02:52.951114 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:02:52.951626 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:02:52.952156 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:02:52.962295 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:52.966318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:52.967225 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:52.967903 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:52.988535 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Getting quotas for project f7713dfabbe6446fac28d0b194ca627a. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:02:52.992575 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Getting quotas for user 98724cc2db0e4404bbc71b3ae864ecfa and project f7713dfabbe6446fac28d0b194ca627a. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:02:53.007084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:02:53.010795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74b56e12-6dd0-456a-8625-2a4ebba692d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:02:53.063132 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-02c25f53-59bd-4f73-b783-357ebbceabd7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579321 May 13 13:02:53.063976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 415/806] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:02:53.075190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-afade26b-a518-415d-83e5-3640435e8eca tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:53.076217 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-afade26b-a518-415d-83e5-3640435e8eca tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:53.142571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-afade26b-a518-415d-83e5-3640435e8eca tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:53.150009 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-afade26b-a518-415d-83e5-3640435e8eca tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1257 microversion: 2.1 time: 0.080235 May 13 13:02:53.151746 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 392/807] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:53 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1257 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:02:54.169091 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:54.169710 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:54.175738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:54.176191 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:54.176958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:54.177422 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:54.239639 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:54.250096 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fc6cdd61-7169-432d-b8e4-41d166b7ba74 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1309 microversion: 2.1 time: 0.085546 May 13 13:02:54.250853 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 416/808] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:54 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:55.268258 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:55.272849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:55.281415 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:55.290989 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:55.294626 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:55.298189 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:55.515525 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:55.533091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b9b69015-0f3f-4fee-b9ca-8d6334b0efd5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.268834 May 13 13:02:55.535121 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 393/809] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:55 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:56.551694 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:56.552517 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:56.559905 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:56.560457 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:56.561347 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:56.561841 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:56.726971 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:56.735800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-83f165fe-4ec9-4eba-b487-6b28270b9d60 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.187733 May 13 13:02:56.745414 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 417/810] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:56 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:02:57.720948 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:57.722301 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:57.729411 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:57.730191 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:57.731175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:57.731661 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:57.753222 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:57.754662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:57.762252 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:57.762995 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:57.763789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:57.764256 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:57.833783 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lazy-loading 'services' on Instance uuid 287d423f-698a-400e-9798-80bcaf60cc1b {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:02:57.921971 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:57.929690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-cd801ccb-1263-4f0f-b5bf-00319ba9f107 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.180220 May 13 13:02:57.939265 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 418/811] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:57 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:02:57.944198 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b9b2761c-e6de-4c0e-a7c9-cbbeaaa95eb3 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b/os-volume_attachments/1cceaa64-a833-45e7-a1e6-050126b5199d" status: 202 len: 0 microversion: 2.1 time: 0.227627 May 13 13:02:57.945048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 394/812] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 13:02:57 2022] DELETE /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b/os-volume_attachments/1cceaa64-a833-45e7-a1e6-050126b5199d => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:02:58.947125 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:02:58.948026 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:02:58.954878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:58.955375 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:58.956163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:02:58.956615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:02:59.112678 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:02:59.121255 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-39358568-83b8-483e-b1f6-cebba6c77725 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.178125 May 13 13:02:59.121844 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 419/813] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:02:58 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:00.139384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:00.140086 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:00.146868 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:00.147326 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:00.148088 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:00.148814 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:00.310086 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:00.319634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d209dde7-9a1c-4424-a021-a7e7011791ae tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.184667 May 13 13:03:00.320552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 395/814] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:00 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:00.372084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-735925077", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1219736643", "security_groups": [{"name": "tempest-secgroup-smoke-2036298892"}], "block_device_mapping_v2": [{"uuid": "63f732d7-0866-4e34-8030-2ce908967b41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aff18e0d-eb20-4ef6-a9a5-21ad8f6c2af1"}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:00.493801 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] validate_networks() for [('aff18e0d-eb20-4ef6-a9a5-21ad8f6c2af1', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:03:00.888259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:03:00.888684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:03:00.889373 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:03:00.889612 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:03:00.890025 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:03:00.899621 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:00.900369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:00.902050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:00.902824 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:00.920659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:03:00.924541 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for user 0956067c32cd476a8db7ee074f210700 and project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:03:00.984515 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:03:00.986738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63f732d7-0866-4e34-8030-2ce908967b41',volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:03:01.126281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e0da4bdd-8cbe-49a8-86a4-04a0b11b5142 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758789 May 13 13:03:01.127200 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 420/815] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:03:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:03:01.137065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-32156412-15c2-41e0-8572-daf7f7665c8d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:01.137949 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-32156412-15c2-41e0-8572-daf7f7665c8d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:01.208772 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-32156412-15c2-41e0-8572-daf7f7665c8d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:01.218237 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-32156412-15c2-41e0-8572-daf7f7665c8d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1094 microversion: 2.1 time: 0.084080 May 13 13:03:01.228573 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 396/816] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:01 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:01.340689 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:01.341365 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:01.347611 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:01.348175 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:01.349102 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:01.349610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:01.563394 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:01.571001 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a387f928-1de4-487b-b14b-e828225b1487 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.234965 May 13 13:03:01.571645 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 421/817] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:01 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:02.235819 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:02.236390 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:02.243857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:02.244308 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:02.245361 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:02.245815 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:02.313789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:02.324471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-bf170f51-64a1-472b-8c04-a387df6c2114 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1144 microversion: 2.1 time: 0.089784 May 13 13:03:02.325909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 397/818] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:02 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:02.587674 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:02.588292 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:02.595250 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:02.595705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:02.596478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:02.596921 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:02.725829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:02.733238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-161f2e89-436b-438d-a0a9-e323afd67f5f tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.149491 May 13 13:03:02.733808 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 422/819] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:02 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:03.343880 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:03.345148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:03.351538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:03.352086 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:03.352872 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:03.353355 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:03.690985 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:03.698468 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ed0bfe2d-9f1f-4bf7-b3c7-82e6fcfd9334 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1136 microversion: 2.1 time: 0.359182 May 13 13:03:03.700264 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 398/820] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:03 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1136 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:03.750153 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:03.750771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:03.758147 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:03.759148 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:03.759954 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:03.760393 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:03.916123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:03.925758 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5840e381-4e0b-4cdc-bcc6-c9e4ed8ba353 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.179386 May 13 13:03:03.927587 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 423/821] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:03 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:04.017884 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-3c7b6c5f-dbbb-4c94-aa07-3c2007fdf724 req-b78c63bc-e0a8-4f55-a65e-644dcf71cce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5", "tag": "90cfa8c9-1331-41ca-84e5-e5be3729e414"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:04.029435 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-3c7b6c5f-dbbb-4c94-aa07-3c2007fdf724 req-b78c63bc-e0a8-4f55-a65e-644dcf71cce2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.030419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-3c7b6c5f-dbbb-4c94-aa07-3c2007fdf724 req-b78c63bc-e0a8-4f55-a65e-644dcf71cce2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.048929 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-3c7b6c5f-dbbb-4c94-aa07-3c2007fdf724 req-b78c63bc-e0a8-4f55-a65e-644dcf71cce2 service nova] Creating event network-changed:90cfa8c9-1331-41ca-84e5-e5be3729e414 for instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 on hv-cinder-84164 May 13 13:03:04.056601 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-3c7b6c5f-dbbb-4c94-aa07-3c2007fdf724 req-b78c63bc-e0a8-4f55-a65e-644dcf71cce2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043834 May 13 13:03:04.057720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 399/822] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:04.448210 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:04.448744 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:04.454619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.454996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.455768 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.456206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.481697 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:03:04.565247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d9c5df04-ab1d-4e19-9666-ff903a01572a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 204 len: 0 microversion: 2.1 time: 0.120465 May 13 13:03:04.567132 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 424/823] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:03:04 2022] DELETE /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:03:04.576643 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:04.577525 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:04.584011 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.584461 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.585354 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.585820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.717007 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:04.717808 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:04.723706 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.724161 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.724945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.725441 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.797916 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:04.805508 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:04.806235 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-06b11bae-2cf5-4b77-883b-e5959e53da83 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1210 microversion: 2.1 time: 0.094090 May 13 13:03:04.806993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 425/824] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:04 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:04.813777 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-82046e8d-e1f2-43b6-846c-aa8bee2b41cd tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1515 microversion: 2.1 time: 0.242636 May 13 13:03:04.823427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 400/825] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:04 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:04.942499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:04.943116 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:04.949686 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.950163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:04.950935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:04.951368 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:05.091818 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:05.100536 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e20817e3-db63-490a-a757-28a9c7345e27 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.161756 May 13 13:03:05.101654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 426/826] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:04 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:05.824098 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:05.824715 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:05.830605 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:05.831159 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:05.831287 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:05.831619 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:05.832406 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:05.832852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:05.837648 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:05.838132 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:05.838905 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:05.839862 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:05.966395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:05.969572 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:05.975021 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4ecaf81d-4221-4eac-b001-9228837e03c3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1278 microversion: 2.1 time: 0.154829 May 13 13:03:05.977594 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 401/827] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:05 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:05.980453 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7fb652bb-af1c-47ff-a378-23aba0fce616 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1515 microversion: 2.1 time: 0.153058 May 13 13:03:05.981881 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 427/828] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:05 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:06.117996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:06.118615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:06.125796 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:06.126226 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:06.126988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:06.127437 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:06.363910 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:06.372052 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1e0e9f3e-f3de-4526-acd0-611fbc695bfb tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.257770 May 13 13:03:06.372631 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 402/829] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:06 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:06.856797 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-e87d676d-0b2e-444d-adb3-1f4dced5c7a7 req-bf8eeffb-2d5c-4b3f-8f43-dc9e33a0222e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949ac2a1-5fa1-458a-954b-09355d5dfc68", "tag": "dc7acc83-6299-405b-9f2c-a8cefc650198"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:06.873495 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e87d676d-0b2e-444d-adb3-1f4dced5c7a7 req-bf8eeffb-2d5c-4b3f-8f43-dc9e33a0222e service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:06.874106 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e87d676d-0b2e-444d-adb3-1f4dced5c7a7 req-bf8eeffb-2d5c-4b3f-8f43-dc9e33a0222e service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:06.886101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-e87d676d-0b2e-444d-adb3-1f4dced5c7a7 req-bf8eeffb-2d5c-4b3f-8f43-dc9e33a0222e service nova] Creating event network-changed:dc7acc83-6299-405b-9f2c-a8cefc650198 for instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 on hv-cinder-84164 May 13 13:03:06.891055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-e87d676d-0b2e-444d-adb3-1f4dced5c7a7 req-bf8eeffb-2d5c-4b3f-8f43-dc9e33a0222e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041013 May 13 13:03:06.891707 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 428/830] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:06.991888 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:06.992513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:06.998264 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:06.998986 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:07.000203 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:07.000845 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:07.001808 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:07.002256 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:07.005139 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:07.005595 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:07.006386 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:07.006830 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:07.140944 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:07.141764 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:07.148408 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4b2135cb-12bd-4cfe-ad25-9367349fbe15 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1515 microversion: 2.1 time: 0.155006 May 13 13:03:07.149019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 429/831] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:06 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:07.149178 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6850d2f9-52a3-4ae2-9919-2ed2cbc5b3fa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.161200 May 13 13:03:07.149782 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 403/832] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:06 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:07.389303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:07.389893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:07.395925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:07.396382 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:07.397184 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:07.397695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:07.608856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:07.616284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-078bbf5c-3e7a-4d41-9991-5427681788b8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.231807 May 13 13:03:07.626981 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 430/833] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:07 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:08.166402 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:08.166958 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:08.167841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:08.168053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:08.176006 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:08.176149 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:08.176465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:08.176829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:08.177327 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:08.177953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:08.178175 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:08.178803 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:08.264505 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:08.272701 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5144a750-6689-4d3c-a583-bdcc4a51a233 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 200 len: 1473 microversion: 2.1 time: 0.110342 May 13 13:03:08.273354 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 431/834] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:08 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 1473 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:08.333466 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:08.340970 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4a190866-551f-4627-b94c-e581eaaf94ce tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.178714 May 13 13:03:08.341560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 404/835] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:08 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:08.634190 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:08.634723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:08.641338 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:08.641772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:08.642538 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:08.642987 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:08.777726 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:08.785287 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ceb1b898-fa06-414a-af8b-2fbbb0186c70 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.154978 May 13 13:03:08.785855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 432/836] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:08 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:08.905877 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-bacd1273-e89c-4cc5-a171-bfb81fc068a3 req-233f958e-ff96-44b3-9205-2c47d00d7ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287d423f-698a-400e-9798-80bcaf60cc1b", "name": "network-vif-deleted", "tag": "dcd85070-3bae-40b6-8131-30f8c785f8e8"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:08.914191 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-bacd1273-e89c-4cc5-a171-bfb81fc068a3 req-233f958e-ff96-44b3-9205-2c47d00d7ce2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:08.914636 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-bacd1273-e89c-4cc5-a171-bfb81fc068a3 req-233f958e-ff96-44b3-9205-2c47d00d7ce2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:08.925422 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-bacd1273-e89c-4cc5-a171-bfb81fc068a3 req-233f958e-ff96-44b3-9205-2c47d00d7ce2 service nova] Creating event network-vif-deleted:dcd85070-3bae-40b6-8131-30f8c785f8e8 for instance 287d423f-698a-400e-9798-80bcaf60cc1b on hv-cinder-84164 May 13 13:03:08.930464 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-bacd1273-e89c-4cc5-a171-bfb81fc068a3 req-233f958e-ff96-44b3-9205-2c47d00d7ce2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029043 May 13 13:03:08.931056 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 405/837] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:09.289374 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:09.289927 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: 287d423f-698a-400e-9798-80bcaf60cc1b] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:09.296183 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:09.296631 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:09.297419 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:09.297853 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:09.311475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] HTTP exception thrown: Instance 287d423f-698a-400e-9798-80bcaf60cc1b could not be found. May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Request method failure captured: May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b HTTP/1.1 May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABifla_IaoCZP9A0ERzfznsaZwoTh2cbMVWNesboZphjWKUdgTpHQq3HnsZWPK7ma79mWDVzTgvG4Fzq_Y2s76sXFgLBOwSlAi7qzgES6Rr-ZuP2JJD91eT65HQ4GfdBpbtMD-t7JIdzow1j043uOqXIT4yRaS6-39Njkg_FR7npDe8TMc May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: c04aaf2b58354e1992d66c09f5f562ad May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1761476549 May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:03:09.313112 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c04aaf2b58354e1992d66c09f5f562ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c04aaf2b58354e1992d66c09f5f562ad", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c04aaf2b58354e1992d66c09f5f562ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c04aaf2b58354e1992d66c09f5f562ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-VolumesSnapshotTestJSON-1761476549 May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: c04aaf2b58354e1992d66c09f5f562ad May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1761476549 May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-VolumesSnapshotTestJSON-1761476549-project May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 7410940d292d436d9adb0421144d8af3 May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-VolumesSnapshotTestJSON-1761476549-project May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 287d423f-698a-400e-9798-80bcaf60cc1b could not be found. May 13 13:03:09.314771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '287d423f-698a-400e-9798-80bcaf60cc1b'} May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287d423f-698a-400e-9798-80bcaf60cc1b could not be found. May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:03:09.315754 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287d423f-698a-400e-9798-80bcaf60cc1b could not be found. May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287d423f-698a-400e-9798-80bcaf60cc1b could not be found. May 13 13:03:09.317443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:09.318875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Returning 404 to user: Instance 287d423f-698a-400e-9798-80bcaf60cc1b could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:03:09.318875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7531bcb0-d7b3-4746-90c1-b86014ff5a20 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b" status: 404 len: 111 microversion: 2.1 time: 0.029306 May 13 13:03:09.318875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 433/838] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:09 2022] GET /compute/v2.1/servers/287d423f-698a-400e-9798-80bcaf60cc1b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:03:09.358360 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:09.359064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:09.365014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:09.365464 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:09.366226 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:09.366660 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:09.522047 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:09.529649 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4bfd6bee-8a90-4029-805a-35fff9053c0b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.175842 May 13 13:03:09.530232 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 406/839] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:09 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:09.802945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:09.803563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:09.810448 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:09.810896 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:09.811661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:09.812095 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:09.941833 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:09.949761 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-68c2a966-429a-42c4-a85f-2ad59a5189af tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.150605 May 13 13:03:09.950339 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 434/840] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:09 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:10.547314 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:10.547928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:10.554363 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:10.554814 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:10.555584 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:10.556026 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:10.682065 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:10.691035 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6fb09db4-1377-4075-a776-a254a76d5626 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.147484 May 13 13:03:10.691604 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 407/841] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:10 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:10.967312 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:10.968003 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:10.976206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:10.976661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:10.977470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:10.977915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:11.109410 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:11.116632 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9812c8b2-c87d-4359-bc58-fa1d1066dbf9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.153969 May 13 13:03:11.117223 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 435/842] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:10 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:11.707449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:11.708080 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:11.715239 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:11.715693 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:11.716503 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:11.716943 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:11.848559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:11.855820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a763dc81-d666-4d05-ab5c-1a97f0794b5a tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.152550 May 13 13:03:11.856386 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 408/843] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:11 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:12.133892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:12.134479 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:12.141026 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:12.141478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:12.142239 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:12.142671 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:12.271141 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:12.278839 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-a7a36d30-296f-4d3b-b00c-57be8bdd5ba9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.148845 May 13 13:03:12.279413 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 436/844] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:12 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:12.871624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:12.872234 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:12.878623 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:12.879076 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:12.880044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:12.880588 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:13.021424 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:13.029419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2de00be8-0d7f-46d3-b870-f98a4c3b53f7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.161732 May 13 13:03:13.029996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 409/845] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:12 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:13.296214 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:13.296803 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:13.303015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:13.303460 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:13.304219 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:13.304651 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:13.429708 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:13.437671 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d280915c-0305-4a9d-ba6b-fb98ccf82046 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.145597 May 13 13:03:13.438241 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 437/846] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:13 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:14.046735 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:14.047271 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:14.053546 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:14.053992 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:14.054752 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:14.055190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:14.187781 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:14.195099 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b0463b4f-dd82-46ac-b5c7-8b007533253f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.152434 May 13 13:03:14.195669 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 410/847] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:14 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:14.454566 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:14.455178 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:14.461442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:14.461888 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:14.462656 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:14.463088 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:14.591579 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:14.598994 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-03043e35-7f57-4122-b43a-f93dd29d215e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.148285 May 13 13:03:14.599572 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 438/848] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:14 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:15.212000 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:15.212526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:15.219858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:15.220320 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:15.221142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:15.221589 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:15.359129 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:15.366449 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-378e94c5-0791-47ea-8962-a4815ae00c9d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.158361 May 13 13:03:15.367028 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 411/849] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:15 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:15.616443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:15.616961 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:15.623897 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:15.624342 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:15.625128 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:15.625559 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:15.756706 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:15.763916 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-eebf3dbe-46f2-4722-87ed-168e866abe84 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.151530 May 13 13:03:15.764484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 439/850] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:15 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:16.111389 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-359071fa-3313-4559-83ef-322338b87c5b req-1ad12948-9ba4-495a-b37e-b65c29e0e013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5", "name": "network-vif-plugged", "status": "completed", "tag": "90cfa8c9-1331-41ca-84e5-e5be3729e414"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:16.119275 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-359071fa-3313-4559-83ef-322338b87c5b req-1ad12948-9ba4-495a-b37e-b65c29e0e013 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:16.119729 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-359071fa-3313-4559-83ef-322338b87c5b req-1ad12948-9ba4-495a-b37e-b65c29e0e013 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:16.130922 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-359071fa-3313-4559-83ef-322338b87c5b req-1ad12948-9ba4-495a-b37e-b65c29e0e013 service nova] Creating event network-vif-plugged:90cfa8c9-1331-41ca-84e5-e5be3729e414 for instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 on hv-cinder-84164 May 13 13:03:16.135777 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-359071fa-3313-4559-83ef-322338b87c5b req-1ad12948-9ba4-495a-b37e-b65c29e0e013 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028086 May 13 13:03:16.136503 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 412/851] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:16.383589 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:16.384125 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:16.390644 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:16.391093 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:16.391851 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:16.392281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:16.517851 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:16.525186 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-82dfd0a1-dd31-4928-bbbb-33905d696719 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.145431 May 13 13:03:16.525761 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 440/852] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:16 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:16.781398 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:16.782100 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:16.788674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:16.789157 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:16.790291 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:16.790735 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:16.928538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:16.938083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-79fcf1e4-cdb3-4cf8-be82-45a6398fc576 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.161448 May 13 13:03:16.938688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 413/853] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:16 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:17.124942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1686779755", "imageRef": "c10f748d-b213-435e-bd89-5f4c88020a3a", "flavorRef": "452", "networks": [{"uuid": "9564931c-c5b5-4379-ab8f-8be704e0bc3e"}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:17.176101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] validate_networks() for [('9564931c-c5b5-4379-ab8f-8be704e0bc3e', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:03:17.513114 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:03:17.513533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:03:17.514002 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:03:17.514404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:03:17.514809 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:03:17.523291 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:17.523733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:17.524525 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:17.524957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:17.543268 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Getting quotas for project c04aaf2b58354e1992d66c09f5f562ad. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:03:17.543891 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:17.544756 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:17.546748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Getting quotas for user 7410940d292d436d9adb0421144d8af3 and project c04aaf2b58354e1992d66c09f5f562ad. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:03:17.550511 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:17.550963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:17.551736 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:17.552175 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:17.557413 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:03:17.560271 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c10f748d-b213-435e-bd89-5f4c88020a3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:03:17.608707 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-356f092d-67f6-4d73-abb9-2cd50b793f95 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488113 May 13 13:03:17.609519 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 441/854] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:03:17.619894 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-3a3e7330-85be-4c21-aafb-dfcfca396d06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:17.621079 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-3a3e7330-85be-4c21-aafb-dfcfca396d06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:17.682135 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-3a3e7330-85be-4c21-aafb-dfcfca396d06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:17.688586 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:17.691572 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-3a3e7330-85be-4c21-aafb-dfcfca396d06 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1219 microversion: 2.1 time: 0.075862 May 13 13:03:17.692516 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 442/855] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:17 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:17.696618 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7ff606ae-b23e-40c1-a9be-9f3e3eab3957 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.157421 May 13 13:03:17.697433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 414/856] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:17 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:17.955445 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:17.956085 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:17.962981 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:17.963433 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:17.966275 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:17.966905 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:18.102207 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:18.109563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-24a08176-4ae1-4f56-9fa7-3c33771ceef5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1357 microversion: 2.1 time: 0.158161 May 13 13:03:18.110053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 443/857] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:17 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:18.709325 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:18.710052 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:18.714023 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:18.715303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:18.717015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:18.717419 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:18.718232 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:18.718676 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:18.721422 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:18.728564 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:18.730058 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:18.730512 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:18.805915 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:18.815285 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b22ac4f3-ec8d-4012-b24d-a3142730415b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1271 microversion: 2.1 time: 0.108895 May 13 13:03:18.816479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 415/858] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:18 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:18.878897 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:18.887026 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c4c91768-a249-40dd-b6f9-5bb060a1d0d4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.176788 May 13 13:03:18.887439 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 444/859] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:18 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:18.912554 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-72c3e237-0473-4e55-bd9e-d417af996948 req-3dbc193f-f15a-41b8-a62c-6648c520e549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949ac2a1-5fa1-458a-954b-09355d5dfc68", "name": "network-vif-plugged", "status": "completed", "tag": "dc7acc83-6299-405b-9f2c-a8cefc650198"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:18.922418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-72c3e237-0473-4e55-bd9e-d417af996948 req-3dbc193f-f15a-41b8-a62c-6648c520e549 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:18.922969 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-72c3e237-0473-4e55-bd9e-d417af996948 req-3dbc193f-f15a-41b8-a62c-6648c520e549 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:18.935659 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-72c3e237-0473-4e55-bd9e-d417af996948 req-3dbc193f-f15a-41b8-a62c-6648c520e549 service nova] Creating event network-vif-plugged:dc7acc83-6299-405b-9f2c-a8cefc650198 for instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 on hv-cinder-84164 May 13 13:03:18.940514 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-72c3e237-0473-4e55-bd9e-d417af996948 req-3dbc193f-f15a-41b8-a62c-6648c520e549 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031995 May 13 13:03:18.941143 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 416/860] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:19.126567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:19.127180 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:19.133887 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.134367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.135639 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.136330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.357592 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:19.365157 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-56ec85ce-5556-4100-8e3d-2bec1c42ca66 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1546 microversion: 2.1 time: 0.242458 May 13 13:03:19.365743 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 445/861] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:19 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:19.385568 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:19.386895 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:19.393991 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.394582 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.395454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.396077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.528793 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:19.536291 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cae42392-664e-4dce-a034-f10fa0b77421 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1546 microversion: 2.1 time: 0.157750 May 13 13:03:19.536880 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 417/862] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:19 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:19.552813 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:19.556449 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:19.557267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Searching by: {'deleted': False, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a'} {{(pid=123410) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 13:03:19.565101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.565555 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.566367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.566815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.659050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.multi_cell_list [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 13:03:19.758945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ba93725e-4c4d-4aad-aa66-11feee179eb8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209944 May 13 13:03:19.759635 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 446/863] 10.222.0.49 () {58 vars in 1124 bytes} [Fri May 13 13:03:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:19.770367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:19.771071 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:19.778249 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.778796 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.779646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.780183 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.832658 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:19.833318 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:19.840463 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.840920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.841874 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.842170 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.919246 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:19.926834 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fd952a39-239d-4e0c-ad60-ab806e312a57 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1546 microversion: 2.1 time: 0.160371 May 13 13:03:19.936665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 418/864] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:19 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:19.936665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:19.936665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:19.938420 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.938888 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:19.939669 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:19.940245 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:20.102559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:20.113971 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-901e1b89-21df-40d3-8c6f-e8ed2d1229e8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1266 microversion: 2.1 time: 0.185386 May 13 13:03:20.115573 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 419/865] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:19 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:20.330053 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:20.338652 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-df2dced3-c684-4eab-97ee-65ca1b96d74a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.509751 May 13 13:03:20.339236 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 447/866] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:19 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:20.935014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-d01c01a1-f9a3-40db-90a9-df8e428f61dd req-2807eade-37b0-4656-9576-89ee55f91dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baac7c00-7269-49fa-a240-e0ed374aeed2", "tag": "00b177da-51c3-43ba-b55a-e7aefc42273b"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:20.944041 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-d01c01a1-f9a3-40db-90a9-df8e428f61dd req-2807eade-37b0-4656-9576-89ee55f91dc3 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:20.953292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-d01c01a1-f9a3-40db-90a9-df8e428f61dd req-2807eade-37b0-4656-9576-89ee55f91dc3 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:20.967455 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-d01c01a1-f9a3-40db-90a9-df8e428f61dd req-2807eade-37b0-4656-9576-89ee55f91dc3 service nova] Creating event network-changed:00b177da-51c3-43ba-b55a-e7aefc42273b for instance baac7c00-7269-49fa-a240-e0ed374aeed2 on hv-cinder-84164 May 13 13:03:20.978152 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-d01c01a1-f9a3-40db-90a9-df8e428f61dd req-2807eade-37b0-4656-9576-89ee55f91dc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046688 May 13 13:03:20.979288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 420/867] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:21.131620 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:21.132290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:21.139475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.139918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.140687 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.141154 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.356397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:21.357288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:21.363369 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.363823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.364608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.365134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.477726 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:21.486059 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f46747f4-4eb6-44d3-8d18-69be5d2b5b55 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1453 microversion: 2.1 time: 0.358196 May 13 13:03:21.486892 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 448/868] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:21 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1453 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:21.501920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:21.502545 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:21.508633 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.509122 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.509909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.510378 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.512486 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:21.529083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-5726ba3f-6c3e-49a7-97a2-b9d8c235d93d tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.177001 May 13 13:03:21.530092 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 421/869] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:21 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:21.534944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3e96eb6e-0fe0-41b1-80b0-ce41ddc162fe tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "433e97d1-8a9d-44bc-bd3c-b960b7492155"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:21.536351 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3e96eb6e-0fe0-41b1-80b0-ce41ddc162fe tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:21.542592 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e96eb6e-0fe0-41b1-80b0-ce41ddc162fe tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.543963 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e96eb6e-0fe0-41b1-80b0-ce41ddc162fe tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.544905 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e96eb6e-0fe0-41b1-80b0-ce41ddc162fe tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:21.545434 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3e96eb6e-0fe0-41b1-80b0-ce41ddc162fe tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:21.641673 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:21.649011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4af1e061-a188-4a60-975b-757116746cfa tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1453 microversion: 2.1 time: 0.150847 May 13 13:03:21.649599 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 449/870] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:21 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:22.507720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3e96eb6e-0fe0-41b1-80b0-ce41ddc162fe tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.976277 May 13 13:03:22.510191 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 422/871] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 13:03:21 2022] POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments => generated 194 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:22.546071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:22.546727 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:22.553855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:22.554314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:22.555880 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:22.556340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:22.921720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:22.929117 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-baf3745e-fd15-4495-abda-12a8e858eb22 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.386858 May 13 13:03:22.929684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 450/872] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:22 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:23.802179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-c5ab5738-83bb-4ff7-b30b-a66af76360ee req-1c04cc6a-1ef2-43b9-83cc-f05977e7717d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949ac2a1-5fa1-458a-954b-09355d5dfc68", "tag": "dc7acc83-6299-405b-9f2c-a8cefc650198"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:23.810725 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c5ab5738-83bb-4ff7-b30b-a66af76360ee req-1c04cc6a-1ef2-43b9-83cc-f05977e7717d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:23.811179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-c5ab5738-83bb-4ff7-b30b-a66af76360ee req-1c04cc6a-1ef2-43b9-83cc-f05977e7717d service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:23.822457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-c5ab5738-83bb-4ff7-b30b-a66af76360ee req-1c04cc6a-1ef2-43b9-83cc-f05977e7717d service nova] Creating event network-changed:dc7acc83-6299-405b-9f2c-a8cefc650198 for instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 on hv-cinder-84164 May 13 13:03:23.828191 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-c5ab5738-83bb-4ff7-b30b-a66af76360ee req-1c04cc6a-1ef2-43b9-83cc-f05977e7717d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030341 May 13 13:03:23.828728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 423/873] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:23.946646 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:23.947482 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:23.954595 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:23.955050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:23.955830 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:23.956484 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:24.102047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:24.110742 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1b3ad4bd-f799-45e1-92ef-01866424c9e4 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.167915 May 13 13:03:24.111323 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 451/874] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:23 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:25.128637 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:25.129370 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:25.135427 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:25.135882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:25.136656 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:25.137444 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:25.263518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:25.270909 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-08344654-12f5-463f-b79d-fa4f755c2fce tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.146986 May 13 13:03:25.271511 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 424/875] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:25 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:26.288392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:26.288963 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:26.295896 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:26.296345 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:26.297152 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:26.297596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:26.434640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:26.441909 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0041e2d0-ed1f-4492-9df4-9d7163449abe tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.157733 May 13 13:03:26.442482 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 452/876] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:26 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:26.906388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-5079f0d8-a2b9-4aee-ac59-a90bb26fc8cd req-9142d750-aed1-42db-b32e-e8ab9bc3fc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baac7c00-7269-49fa-a240-e0ed374aeed2", "name": "network-vif-plugged", "status": "completed", "tag": "00b177da-51c3-43ba-b55a-e7aefc42273b"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:26.914864 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-5079f0d8-a2b9-4aee-ac59-a90bb26fc8cd req-9142d750-aed1-42db-b32e-e8ab9bc3fc91 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:26.915312 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-5079f0d8-a2b9-4aee-ac59-a90bb26fc8cd req-9142d750-aed1-42db-b32e-e8ab9bc3fc91 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:26.926364 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-5079f0d8-a2b9-4aee-ac59-a90bb26fc8cd req-9142d750-aed1-42db-b32e-e8ab9bc3fc91 service nova] Creating event network-vif-plugged:00b177da-51c3-43ba-b55a-e7aefc42273b for instance baac7c00-7269-49fa-a240-e0ed374aeed2 on hv-cinder-84164 May 13 13:03:26.931101 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-5079f0d8-a2b9-4aee-ac59-a90bb26fc8cd req-9142d750-aed1-42db-b32e-e8ab9bc3fc91 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029022 May 13 13:03:26.931702 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 425/877] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:27.460433 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:27.461404 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:27.469922 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:27.470596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:27.471758 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:27.472420 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:27.601736 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:27.609442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e55023db-477c-40dd-9bbe-3faf4914ec11 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.154279 May 13 13:03:27.610012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 453/878] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:27 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:28.627967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:28.628785 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:28.634858 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:28.635311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:28.636080 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:28.636572 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:28.766604 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:28.774043 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ba2c8d1c-be06-4b32-8477-bf97b23f87e0 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1319 microversion: 2.1 time: 0.150606 May 13 13:03:28.774627 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 426/879] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:28 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:29.791872 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:29.792623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:29.799640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:29.800101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:29.800883 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:29.801361 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:29.937748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:29.945037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8b06027e-57a5-4173-a6c2-68bc1e347177 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1508 microversion: 2.1 time: 0.157403 May 13 13:03:29.945599 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 454/880] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:29 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:29.961317 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-608ce8ca-fa33-447c-bcce-3ef2773e799b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d96b3ae-75b0-4411-87f7-483b90dea085", "device": "/dev/sdb"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:29.962991 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-608ce8ca-fa33-447c-bcce-3ef2773e799b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:29.970156 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-608ce8ca-fa33-447c-bcce-3ef2773e799b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:29.970612 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-608ce8ca-fa33-447c-bcce-3ef2773e799b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:29.971397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-608ce8ca-fa33-447c-bcce-3ef2773e799b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:29.971866 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-608ce8ca-fa33-447c-bcce-3ef2773e799b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:30.069975 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:30.070602 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:30.077661 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:30.078120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:30.078901 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:30.079346 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:30.218343 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:30.226445 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ca08bd55-cb63-44b8-a358-3e6ef1ad42f4 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1592 microversion: 2.1 time: 0.160189 May 13 13:03:30.227001 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 455/881] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:30 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1592 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:03:30.246521 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-608ce8ca-fa33-447c-bcce-3ef2773e799b tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "POST /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288016 May 13 13:03:30.247176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 427/882] 10.222.0.49 () {60 vars in 1322 bytes} [Fri May 13 13:03:29 2022] POST /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:31.929304 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-04bcd30d-771d-4322-8b14-764165a634b3 req-316be048-0642-4351-946b-9f52b9f7751b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5", "tag": "90cfa8c9-1331-41ca-84e5-e5be3729e414"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:31.942601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-04bcd30d-771d-4322-8b14-764165a634b3 req-316be048-0642-4351-946b-9f52b9f7751b service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:31.943116 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-04bcd30d-771d-4322-8b14-764165a634b3 req-316be048-0642-4351-946b-9f52b9f7751b service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:31.955846 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-04bcd30d-771d-4322-8b14-764165a634b3 req-316be048-0642-4351-946b-9f52b9f7751b service nova] Creating event network-changed:90cfa8c9-1331-41ca-84e5-e5be3729e414 for instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 on hv-cinder-84164 May 13 13:03:31.961014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-04bcd30d-771d-4322-8b14-764165a634b3 req-316be048-0642-4351-946b-9f52b9f7751b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035240 May 13 13:03:31.962048 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 456/883] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:33.144804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-578362912"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:33.145459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:33.152176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:33.152620 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:33.153412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:33.153847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:33.281998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.network.security_group_api [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Adding security group 93013e7d-1f57-4731-8238-98ee55983c74 to port 90cfa8c9-1331-41ca-84e5-e5be3729e414 May 13 13:03:33.617016 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8c161374-1258-4b4a-b9ae-b571fcc349f7 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/action" status: 202 len: 0 microversion: 2.1 time: 0.476285 May 13 13:03:33.617633 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 428/884] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 13:03:33 2022] POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:03:33.630037 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:33.631444 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:33.641416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:33.642324 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:33.643513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:33.644523 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:33.811555 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:33.819585 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c8c06640-05d2-431a-a2ff-d32b2344f88e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1757 microversion: 2.1 time: 0.196148 May 13 13:03:33.820337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 457/885] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:33 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:33.980184 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-73ebb2f5-3e02-48dd-81c6-c83052273dcf req-29725037-cc26-4dec-b0a0-37f16385d317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5", "tag": "90cfa8c9-1331-41ca-84e5-e5be3729e414"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:33.988185 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-73ebb2f5-3e02-48dd-81c6-c83052273dcf req-29725037-cc26-4dec-b0a0-37f16385d317 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:33.988622 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-73ebb2f5-3e02-48dd-81c6-c83052273dcf req-29725037-cc26-4dec-b0a0-37f16385d317 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:34.000176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-73ebb2f5-3e02-48dd-81c6-c83052273dcf req-29725037-cc26-4dec-b0a0-37f16385d317 service nova] Creating event network-changed:90cfa8c9-1331-41ca-84e5-e5be3729e414 for instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 on hv-cinder-84164 May 13 13:03:34.005236 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-73ebb2f5-3e02-48dd-81c6-c83052273dcf req-29725037-cc26-4dec-b0a0-37f16385d317 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028676 May 13 13:03:34.005838 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 429/886] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:49.520619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:49.521189 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:49.529185 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:49.529876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:49.531060 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:49.531733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:49.622305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lazy-loading 'services' on Instance uuid baac7c00-7269-49fa-a240-e0ed374aeed2 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:03:49.690823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7557e198-5610-4985-857c-2159f4e70e09 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2/os-volume_attachments/6d96b3ae-75b0-4411-87f7-483b90dea085" status: 202 len: 0 microversion: 2.1 time: 0.173919 May 13 13:03:49.691409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 458/887] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 13:03:49 2022] DELETE /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2/os-volume_attachments/6d96b3ae-75b0-4411-87f7-483b90dea085 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:03:50.800043 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:50.800633 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:50.807177 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:50.807630 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:50.809016 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:50.809465 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:50.834190 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:03:50.910327 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f6ade2b6-e4e7-49ef-875f-1839a039833a tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "DELETE /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 204 len: 0 microversion: 2.1 time: 0.114070 May 13 13:03:50.911005 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 430/888] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:03:50 2022] DELETE /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:03:50.921379 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:50.922415 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:50.930694 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:50.931310 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:50.932238 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:50.932707 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:51.059675 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:51.067161 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-59a6a065-e8ff-40ad-8a72-9d8f1e6083d8 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1514 microversion: 2.1 time: 0.151417 May 13 13:03:51.067728 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 459/889] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:50 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:52.084464 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:52.085192 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:52.091393 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:52.091841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:52.092609 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:52.093132 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:52.218359 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:52.225756 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-798dc31b-ffa2-4521-bb2b-e8ed4c968692 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1514 microversion: 2.1 time: 0.145370 May 13 13:03:52.226261 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 431/890] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:52 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:53.242055 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:53.242728 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:53.249510 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:53.249955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:53.250723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:53.251159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:53.315211 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7410940d292d436d9adb0421144d8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04aaf2b58354e1992d66c09f5f562ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:03:53.323479 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b989a13b-6b5a-474c-a749-d289318510ea tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 200 len: 1472 microversion: 2.1 time: 0.085337 May 13 13:03:53.324199 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 460/891] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:53 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:03:53.583823 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-d98196f9-9e23-414d-b2ec-c19a1d71c2b6 req-3216bced-d065-48e1-9f25-2e030f490699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baac7c00-7269-49fa-a240-e0ed374aeed2", "name": "network-vif-deleted", "tag": "00b177da-51c3-43ba-b55a-e7aefc42273b"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:03:53.592706 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-d98196f9-9e23-414d-b2ec-c19a1d71c2b6 req-3216bced-d065-48e1-9f25-2e030f490699 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:53.593173 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-d98196f9-9e23-414d-b2ec-c19a1d71c2b6 req-3216bced-d065-48e1-9f25-2e030f490699 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:53.603695 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-d98196f9-9e23-414d-b2ec-c19a1d71c2b6 req-3216bced-d065-48e1-9f25-2e030f490699 service nova] Creating event network-vif-deleted:00b177da-51c3-43ba-b55a-e7aefc42273b for instance baac7c00-7269-49fa-a240-e0ed374aeed2 on hv-cinder-84164 May 13 13:03:53.608724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-d98196f9-9e23-414d-b2ec-c19a1d71c2b6 req-3216bced-d065-48e1-9f25-2e030f490699 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028581 May 13 13:03:53.609352 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 432/892] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:03:54.340842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:03:54.341424 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] [instance: baac7c00-7269-49fa-a240-e0ed374aeed2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:03:54.347763 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:54.348215 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:54.349015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:03:54.349459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:03:54.362378 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] HTTP exception thrown: Instance baac7c00-7269-49fa-a240-e0ed374aeed2 could not be found. May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Request method failure captured: May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 HTTP/1.1 May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABifla_IaoCZP9A0ERzfznsaZwoTh2cbMVWNesboZphjWKUdgTpHQq3HnsZWPK7ma79mWDVzTgvG4Fzq_Y2s76sXFgLBOwSlAi7qzgES6Rr-ZuP2JJD91eT65HQ4GfdBpbtMD-t7JIdzow1j043uOqXIT4yRaS6-39Njkg_FR7npDe8TMc May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: c04aaf2b58354e1992d66c09f5f562ad May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1761476549 May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:03:54.364068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c04aaf2b58354e1992d66c09f5f562ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c04aaf2b58354e1992d66c09f5f562ad", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c04aaf2b58354e1992d66c09f5f562ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c04aaf2b58354e1992d66c09f5f562ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-VolumesSnapshotTestJSON-1761476549 May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: c04aaf2b58354e1992d66c09f5f562ad May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1761476549 May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-VolumesSnapshotTestJSON-1761476549-project May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 7410940d292d436d9adb0421144d8af3 May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-VolumesSnapshotTestJSON-1761476549-project May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance baac7c00-7269-49fa-a240-e0ed374aeed2 could not be found. May 13 13:03:54.365829 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': 'baac7c00-7269-49fa-a240-e0ed374aeed2'} May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baac7c00-7269-49fa-a240-e0ed374aeed2 could not be found. May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:03:54.366943 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baac7c00-7269-49fa-a240-e0ed374aeed2 could not be found. May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baac7c00-7269-49fa-a240-e0ed374aeed2 could not be found. May 13 13:03:54.368567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:03:54.370072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] Returning 404 to user: Instance baac7c00-7269-49fa-a240-e0ed374aeed2 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:03:54.370072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-70268346-641e-4164-b504-547655bb4d51 tempest-VolumesSnapshotTestJSON-1761476549 tempest-VolumesSnapshotTestJSON-1761476549-project] 10.222.0.49 "GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2" status: 404 len: 111 microversion: 2.1 time: 0.028689 May 13 13:03:54.370072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 461/893] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:03:54 2022] GET /compute/v2.1/servers/baac7c00-7269-49fa-a240-e0ed374aeed2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:04:06.023976 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fa191e1f-098f-47cb-8b92-8d1063bd3803 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:04:06.025154 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fa191e1f-098f-47cb-8b92-8d1063bd3803 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:06.031859 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa191e1f-098f-47cb-8b92-8d1063bd3803 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:06.032307 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa191e1f-098f-47cb-8b92-8d1063bd3803 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:06.033101 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa191e1f-098f-47cb-8b92-8d1063bd3803 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:06.033537 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa191e1f-098f-47cb-8b92-8d1063bd3803 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:06.104838 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fa191e1f-098f-47cb-8b92-8d1063bd3803 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/action" status: 202 len: 0 microversion: 2.1 time: 0.085471 May 13 13:04:06.105574 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 433/894] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 13:04:06 2022] POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:04:06.113666 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:06.114295 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:06.120741 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:06.121230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:06.122011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:06.122455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:06.268808 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:06.276684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b902e5f1-527c-42aa-94c2-0fadc1aad61a tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1749 microversion: 2.1 time: 0.166874 May 13 13:04:06.277288 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 462/895] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:06 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:07.295651 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:07.296528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:07.303077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:07.303610 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:07.304440 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:07.305074 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:07.446505 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:07.454993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a2194211-f30e-4888-bdf0-dce05642d88d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.164253 May 13 13:04:07.455557 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 434/896] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:07 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:08.473382 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:08.474022 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:08.480137 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:08.480591 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:08.481398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:08.481871 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:08.619785 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:08.627590 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1e14ba0a-ab0b-49bc-bb48-d3cb48c9e2ad tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.158785 May 13 13:04:08.628163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 463/897] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:08 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:09.646000 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:09.646643 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:09.652472 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:09.652917 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:09.653706 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:09.654201 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:09.797098 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:09.805016 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1d6e0aed-a497-4657-879f-5db145261e42 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.162931 May 13 13:04:09.805571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 435/898] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:09 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:10.822072 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:10.822726 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:10.829228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:10.829683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:10.830455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:10.830896 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:10.976350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:10.984726 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-eb71972c-357d-421c-a9bf-6c0a9cb118e8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.166515 May 13 13:04:10.985327 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 464/899] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:10 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:04:12.002031 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:12.002742 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:12.009080 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:12.009535 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:12.010309 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:12.010746 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:12.154790 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:12.162771 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0c7e82a5-61a3-47c1-968f-c860b6a78bf8 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.164659 May 13 13:04:12.163345 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 436/900] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:11 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:13.179534 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:13.180160 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:13.186974 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:13.187426 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:13.188196 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:13.188649 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:13.337796 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:13.345671 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b715bb44-97cf-4c33-a15d-fb791bda7a06 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.169984 May 13 13:04:13.346239 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 465/901] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:13 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:14.362849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:14.363495 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:14.369759 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:14.370235 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:14.371003 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:14.371439 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:14.519686 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:14.527384 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1eb7bf73-e75b-4957-bfb5-29cad5bf3e0e tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.168427 May 13 13:04:14.527959 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 437/902] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:14 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:15.545949 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:15.546502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:15.552796 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:15.553283 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:15.554060 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:15.554515 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:15.701159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:15.709348 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-97faff61-34d7-42a8-aca9-4c78cb6f010d tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.167703 May 13 13:04:15.710075 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 466/903] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:15 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:16.727391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:16.728003 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:16.736028 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:16.736482 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:16.737301 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:16.737749 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:16.954481 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:16.962479 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6a155860-9e5e-4cca-b1f8-d8edb1ba44a5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.238909 May 13 13:04:16.963050 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 438/904] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:16 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:17.980002 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:17.981257 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:17.988143 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:17.988600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:17.989430 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:17.989878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:18.136326 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:18.145140 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5742c965-cb54-476b-a09c-83c51ead040b tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.169074 May 13 13:04:18.145711 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 467/905] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:17 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:19.162788 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:19.164090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:19.171513 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:19.172268 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:19.173303 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:19.173917 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:19.346110 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:19.355131 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7c863123-c1b3-40c3-96aa-e280ee59c555 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.196363 May 13 13:04:19.355727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 439/906] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:19 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:20.371899 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:20.374086 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:20.380485 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:20.381410 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:20.382796 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:20.383367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:20.646720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:20.655810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-594b9249-990b-4ba6-bf00-8aff8dfc1a45 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.287906 May 13 13:04:20.656559 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 468/907] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:20 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:21.674538 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:21.675265 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:21.681847 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:21.682593 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:21.683570 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:21.684234 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:21.847339 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:21.855142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cc350b80-9e86-4a81-acbf-681b57ff0cda tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.184756 May 13 13:04:21.855964 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 440/908] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:21 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:04:22.874441 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:22.875080 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:22.891704 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:22.892160 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:22.893012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:22.893672 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:23.427018 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:23.443225 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5a695ae0-edbf-4e30-b912-ea7a915e2ca3 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.573738 May 13 13:04:23.444141 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 469/909] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:22 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:24.461992 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:24.462615 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:24.470421 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:24.471214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:24.472223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:24.472906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:24.740692 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:24.753968 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-3d7dec96-0231-47ab-8db4-1849458da414 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.295147 May 13 13:04:24.755254 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 441/910] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:24 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:25.831003 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:25.834068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:25.846399 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:25.847127 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:25.850068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:25.850729 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:26.240312 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:26.252396 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9c5a69fd-9493-4452-a8bd-e4337155d408 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.428731 May 13 13:04:26.253771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 470/911] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:25 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:27.270505 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:27.271443 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:27.280044 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:27.280580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:27.281624 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:27.282128 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:27.457994 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:27.467831 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a3864747-8296-4809-afd3-938b7220f35c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1754 microversion: 2.1 time: 0.202111 May 13 13:04:27.478223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 442/912] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:27 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:27.969224 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f8a2b91a-9d31-475b-9a54-673bb3ec5ea2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Action: 'create', calling method: .version_select at 0x7f0601f1a700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1193000797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8Ojtfx5pmofvnyPIueJ/0qgQwN4xtjknZ7g7bEhDzGS/l737r4wOLrNJ8Gz0D3MinZkfNdBjr2+Sy9vrQGYLDrzFuG42Wa0qH8hP5ChPEI6eCelXgX216/DpzfrGr/SQ=="}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:04:27.984571 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-f8a2b91a-9d31-475b-9a54-673bb3ec5ea2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Getting quotas for project d43e74ace585434482a887caf9d61c9f. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:04:27.989400 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-f8a2b91a-9d31-475b-9a54-673bb3ec5ea2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Getting quotas for user 1d9be8bbb7804f4f9d170d11636484e1 and project d43e74ace585434482a887caf9d61c9f. Resources: {'key_pairs'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:04:28.013214 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f8a2b91a-9d31-475b-9a54-673bb3ec5ea2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.153508 May 13 13:04:28.014050 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 471/913] 10.222.0.49 () {60 vars in 1158 bytes} [Fri May 13 13:04:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:04:28.485925 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:28.486598 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:28.493709 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:28.494173 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:28.494977 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:28.495533 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:28.665408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:28.674800 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1afaaccf-63c0-418f-914f-f8fc1a6a13e1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1757 microversion: 2.1 time: 0.193614 May 13 13:04:28.676140 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 443/914] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:28 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:04:44.289698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1235774242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1193000797", "security_groups": [{"name": "tempest-secgroup-smoke-1749701364"}], "networks": [{"uuid": "0286a1e2-7023-4be1-8d4b-88b03416ec62"}], "block_device_mapping_v2": [{"uuid": "7bdbdd91-944c-4208-bd81-4098799317e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:04:44.400515 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] validate_networks() for [('0286a1e2-7023-4be1-8d4b-88b03416ec62', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:04:44.774411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:04:44.774793 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:04:44.775275 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:04:44.775695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:04:44.776110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:04:44.785475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:44.785935 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:44.786751 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:44.787447 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:44.804385 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Getting quotas for project d43e74ace585434482a887caf9d61c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:04:44.808282 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Getting quotas for user 1d9be8bbb7804f4f9d170d11636484e1 and project d43e74ace585434482a887caf9d61c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:04:44.883604 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:04:44.886101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bdbdd91-944c-4208-bd81-4098799317e9',volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:04:45.008393 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b2fb5976-e3ca-4d01-ac89-604fc64ce027 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723392 May 13 13:04:45.009076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 472/915] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:04:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:04:45.019412 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-12e51931-3f20-4334-90b2-519544331ccc tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:45.020021 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-12e51931-3f20-4334-90b2-519544331ccc tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:45.073967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-12e51931-3f20-4334-90b2-519544331ccc tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:45.081880 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-12e51931-3f20-4334-90b2-519544331ccc tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1089 microversion: 2.1 time: 0.066710 May 13 13:04:45.082568 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 444/916] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:45 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:46.098805 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:46.099424 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:46.105311 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:46.105761 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:46.106532 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:46.106968 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:46.177724 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:46.186109 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b1398b7d-e114-45a8-a0a4-9bf369331ef6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1187 microversion: 2.1 time: 0.092080 May 13 13:04:46.186955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 473/917] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:46 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:47.203018 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:47.203627 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:47.210426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:47.210877 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:47.211643 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:47.212083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:47.404532 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:47.412756 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2cb9fc40-5d88-4b79-a254-7b9db1cf681b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.213595 May 13 13:04:47.413367 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 445/918] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:47 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:47.706303 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-16373f08-5751-49ba-8dfa-03941be0daeb req-00d77b9d-c01e-4cc2-b8c8-5acfea3a5262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2b6382-3235-4869-8bda-65d55169a432", "tag": "afca9ad0-8e4f-4acb-801e-6a6d41ce806c"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:04:47.715499 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-16373f08-5751-49ba-8dfa-03941be0daeb req-00d77b9d-c01e-4cc2-b8c8-5acfea3a5262 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:47.715877 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-16373f08-5751-49ba-8dfa-03941be0daeb req-00d77b9d-c01e-4cc2-b8c8-5acfea3a5262 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:47.734706 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-16373f08-5751-49ba-8dfa-03941be0daeb req-00d77b9d-c01e-4cc2-b8c8-5acfea3a5262 service nova] Creating event network-changed:afca9ad0-8e4f-4acb-801e-6a6d41ce806c for instance bd2b6382-3235-4869-8bda-65d55169a432 on hv-cinder-84164 May 13 13:04:47.740952 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-16373f08-5751-49ba-8dfa-03941be0daeb req-00d77b9d-c01e-4cc2-b8c8-5acfea3a5262 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039445 May 13 13:04:47.741626 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 474/919] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:04:48.430096 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:48.430755 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:48.437107 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:48.437563 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:48.438332 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:48.439405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:48.652306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:48.659789 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-02421b6a-ceaf-457a-b776-10746aadb3b2 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.233552 May 13 13:04:48.660363 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 446/920] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:48 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:49.678600 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:49.679347 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:49.685619 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:49.686082 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:49.686868 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:49.687311 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:49.818788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:49.826470 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-dbf407ee-0dd5-4710-b5ce-c98d7a8c9ecd tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.153290 May 13 13:04:49.827041 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 475/921] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:49 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:50.843669 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:50.844286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:50.853199 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:50.853717 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:50.854799 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:50.855459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:50.986410 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:50.993585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-32299d4a-1ea7-4574-b323-dc98dc5c8fd6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.153800 May 13 13:04:50.994150 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 447/922] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:50 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:52.009564 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:52.010182 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:52.016552 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:52.017248 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:52.018014 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:52.018456 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:52.147371 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:52.154793 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5098ce6b-8290-44d3-898c-7c8528618256 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.149078 May 13 13:04:52.155370 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 476/923] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:52 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:53.171904 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:53.172528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:53.180046 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:53.180504 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:53.181323 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:53.181772 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:53.308544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:53.316064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-db6bd03c-4c76-48a8-bb12-ab533da9d831 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.148031 May 13 13:04:53.316634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 448/924] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:53 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:54.333263 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:54.333810 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:54.340724 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:54.341199 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:54.341967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:54.342400 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:54.470960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:54.478376 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-874fbd5a-4d1e-480f-b294-a11b084fff4a tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.149775 May 13 13:04:54.478946 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 477/925] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:54 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:55.495626 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:55.496235 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:55.503350 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:55.503805 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:55.504569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:55.505033 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:55.631949 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:55.639158 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6092f6b2-2754-4482-a815-8f304e9855b1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.147394 May 13 13:04:55.639727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 449/926] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:55 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:56.656533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:56.657213 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:56.663977 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:56.664434 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:56.665230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:56.665670 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:56.792977 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:56.801963 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-162b0b29-1f7c-4df3-a441-bec761c5d471 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.149018 May 13 13:04:56.802382 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 478/927] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:56 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:57.819048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:57.819622 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:57.825898 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:57.826350 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:57.827119 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:57.827559 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:57.963246 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:57.973050 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-db88dd81-7a54-4b2d-8d97-61f92b5e6ab8 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.157324 May 13 13:04:57.973872 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 450/928] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:57 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:58.990475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:04:58.991101 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:04:58.997630 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:58.998084 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:58.998876 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:58.999337 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:59.131017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:04:59.138398 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4d1bf03c-c42a-4e05-99d9-ca4b3213e35b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.152012 May 13 13:04:59.138967 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 479/929] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:04:58 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:04:59.384771 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-41a10a25-18da-4000-8d55-94fdf6ba2432 req-b4aa8bed-02a2-4752-9889-bdfaf92e81d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2b6382-3235-4869-8bda-65d55169a432", "name": "network-vif-plugged", "status": "completed", "tag": "afca9ad0-8e4f-4acb-801e-6a6d41ce806c"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:04:59.394469 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-41a10a25-18da-4000-8d55-94fdf6ba2432 req-b4aa8bed-02a2-4752-9889-bdfaf92e81d9 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:04:59.394911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-41a10a25-18da-4000-8d55-94fdf6ba2432 req-b4aa8bed-02a2-4752-9889-bdfaf92e81d9 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:04:59.407118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-41a10a25-18da-4000-8d55-94fdf6ba2432 req-b4aa8bed-02a2-4752-9889-bdfaf92e81d9 service nova] Creating event network-vif-plugged:afca9ad0-8e4f-4acb-801e-6a6d41ce806c for instance bd2b6382-3235-4869-8bda-65d55169a432 on hv-cinder-84164 May 13 13:04:59.412380 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-41a10a25-18da-4000-8d55-94fdf6ba2432 req-b4aa8bed-02a2-4752-9889-bdfaf92e81d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031245 May 13 13:04:59.412990 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 451/930] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:00.155298 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:00.155913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:00.163384 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:00.163837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:00.164617 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:00.165091 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:00.302373 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:00.309659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9c9c078b-aa46-45b7-81e9-23e24f2b4748 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1261 microversion: 2.1 time: 0.158241 May 13 13:05:00.310226 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 480/931] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:00 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:01.327614 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:01.328214 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:01.335591 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:01.336042 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:01.336805 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:01.337279 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:01.468086 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:01.476048 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b3232af9-122e-43fc-8734-d236b752f512 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1445 microversion: 2.1 time: 0.152716 May 13 13:05:01.476609 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 452/932] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:01 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:05:01.491807 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:01.492421 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:01.498662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:01.499109 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:01.499872 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:01.500305 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:01.631929 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:01.639241 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-352f5192-e2c4-4943-8be5-648d3516e09f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1445 microversion: 2.1 time: 0.151239 May 13 13:05:01.639815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 481/933] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:01 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:03.540270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-7d58db62-2ab4-4116-a9f4-982ef56a8217 req-6080d91d-0adb-4e8c-970e-080ae36f3b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2b6382-3235-4869-8bda-65d55169a432", "tag": "afca9ad0-8e4f-4acb-801e-6a6d41ce806c"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:03.549068 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7d58db62-2ab4-4116-a9f4-982ef56a8217 req-6080d91d-0adb-4e8c-970e-080ae36f3b05 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:03.549512 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7d58db62-2ab4-4116-a9f4-982ef56a8217 req-6080d91d-0adb-4e8c-970e-080ae36f3b05 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:03.560003 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-7d58db62-2ab4-4116-a9f4-982ef56a8217 req-6080d91d-0adb-4e8c-970e-080ae36f3b05 service nova] Creating event network-changed:afca9ad0-8e4f-4acb-801e-6a6d41ce806c for instance bd2b6382-3235-4869-8bda-65d55169a432 on hv-cinder-84164 May 13 13:05:03.565804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-7d58db62-2ab4-4116-a9f4-982ef56a8217 req-6080d91d-0adb-4e8c-970e-080ae36f3b05 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029353 May 13 13:05:03.566429 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 453/934] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:04.412610 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-578362912"}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:04.413208 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:04.419842 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:04.420301 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:04.421327 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:04.421770 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:04.547814 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.network.security_group_api [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Removing security group 93013e7d-1f57-4731-8238-98ee55983c74 from port 90cfa8c9-1331-41ca-84e5-e5be3729e414 May 13 13:05:04.891999 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-cd245d12-3581-4dad-9127-6831dc2296e0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/action" status: 202 len: 0 microversion: 2.1 time: 0.482768 May 13 13:05:04.893346 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 482/935] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 13:05:04 2022] POST /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:05:05.582408 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-8ea37223-1a32-4cc1-8257-46d303228899 req-b64a21ad-28dd-4cf0-bade-32ca5729efa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5", "tag": "90cfa8c9-1331-41ca-84e5-e5be3729e414"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:05.590526 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-8ea37223-1a32-4cc1-8257-46d303228899 req-b64a21ad-28dd-4cf0-bade-32ca5729efa7 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:05.590975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-8ea37223-1a32-4cc1-8257-46d303228899 req-b64a21ad-28dd-4cf0-bade-32ca5729efa7 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:05.602661 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-8ea37223-1a32-4cc1-8257-46d303228899 req-b64a21ad-28dd-4cf0-bade-32ca5729efa7 service nova] Creating event network-changed:90cfa8c9-1331-41ca-84e5-e5be3729e414 for instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 on hv-cinder-84164 May 13 13:05:05.607430 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-8ea37223-1a32-4cc1-8257-46d303228899 req-b64a21ad-28dd-4cf0-bade-32ca5729efa7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029720 May 13 13:05:05.608105 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 454/936] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:05.957047 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:05.957590 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:05.963549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:05.964007 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:05.964784 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:05.965245 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:06.049311 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.objects.instance [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lazy-loading 'services' on Instance uuid 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 {{(pid=123410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:05:06.125107 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-eebb67b6-dc39-49fe-a9c0-cbea0d968ef0 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "DELETE /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments/433e97d1-8a9d-44bc-bd3c-b960b7492155" status: 202 len: 0 microversion: 2.1 time: 0.173201 May 13 13:05:06.126300 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 483/937] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 13:05:05 2022] DELETE /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments/433e97d1-8a9d-44bc-bd3c-b960b7492155 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:05:06.134719 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7e4791dc-e49a-49ab-b331-733ff854b619 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:06.136072 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7e4791dc-e49a-49ab-b331-733ff854b619 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:06.142764 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7e4791dc-e49a-49ab-b331-733ff854b619 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:06.143248 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7e4791dc-e49a-49ab-b331-733ff854b619 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:06.144318 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7e4791dc-e49a-49ab-b331-733ff854b619 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:06.144901 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7e4791dc-e49a-49ab-b331-733ff854b619 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:06.176270 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7e4791dc-e49a-49ab-b331-733ff854b619 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 May 13 13:05:06.180339 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 455/938] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:05:06 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:07.189411 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8cbf70e4-3eb0-4d84-af83-afd3f1c49b1c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:07.190509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8cbf70e4-3eb0-4d84-af83-afd3f1c49b1c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:07.197469 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8cbf70e4-3eb0-4d84-af83-afd3f1c49b1c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:07.197925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8cbf70e4-3eb0-4d84-af83-afd3f1c49b1c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:07.198706 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8cbf70e4-3eb0-4d84-af83-afd3f1c49b1c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:07.199148 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8cbf70e4-3eb0-4d84-af83-afd3f1c49b1c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:07.228507 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8cbf70e4-3eb0-4d84-af83-afd3f1c49b1c tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044003 May 13 13:05:07.229002 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 484/939] 10.222.0.49 () {58 vars in 1301 bytes} [Fri May 13 13:05:07 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 13:05:07.239160 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:07.239640 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:07.245844 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:07.246293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:07.247052 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:07.247484 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:07.320339 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] HTTP exception thrown: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 is not attached to volume 433e97d1-8a9d-44bc-bd3c-b960b7492155 May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Request method failure captured: May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: DELETE /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments/433e97d1-8a9d-44bc-bd3c-b960b7492155 HTTP/1.1 May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflbpAUhYraEE18hvmJT6y-RsSG4e4dczCcisDcBG_v9acLUFctG489iVmIoXJIjiAqawV1kXhQCrmv1Wr7gqaOUxA1O1lu-S-PhZnXy8u4Ee54K00-29YjagtK02SZ2_t9xEq-Vj4sgvMqaUcXIZG0N13ubp1V9eWyW2BoNCeyr20vc May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: f7713dfabbe6446fac28d0b194ca627a May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-TestMinimumBasicScenario-1231245002 May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:05:07.322740 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f7713dfabbe6446fac28d0b194ca627a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f7713dfabbe6446fac28d0b194ca627a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f7713dfabbe6446fac28d0b194ca627a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f7713dfabbe6446fac28d0b194ca627a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-TestMinimumBasicScenario-1231245002 May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: f7713dfabbe6446fac28d0b194ca627a May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1231245002 May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-TestMinimumBasicScenario-1231245002-project May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 98724cc2db0e4404bbc71b3ae864ecfa May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-TestMinimumBasicScenario-1231245002-project May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:05:07.324395 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 is not attached to volume 433e97d1-8a9d-44bc-bd3c-b960b7492155 May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'server_id': '24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5', 'id': '433e97d1-8a9d-44bc-bd3c-b960b7492155'} May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 433e97d1-8a9d-44bc-bd3c-b960b7492155. May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:05:07.325310 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 is not attached to volume 433e97d1-8a9d-44bc-bd3c-b960b7492155 May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 is not attached to volume 433e97d1-8a9d-44bc-bd3c-b960b7492155 May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:05:07.326810 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Returning 404 to user: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 is not attached to volume 433e97d1-8a9d-44bc-bd3c-b960b7492155 {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:05:07.328014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6c7cafd0-3815-4025-bed1-4f8981e6a737 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "DELETE /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments/433e97d1-8a9d-44bc-bd3c-b960b7492155" status: 404 len: 154 microversion: 2.1 time: 0.089430 May 13 13:05:07.328014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 456/940] 10.222.0.49 () {58 vars in 1415 bytes} [Fri May 13 13:05:07 2022] DELETE /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5/os-volume_attachments/433e97d1-8a9d-44bc-bd3c-b960b7492155 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:05:07.633917 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-0bc1818a-b6d8-4591-9513-d7c38e22ba3f req-21d587a2-9365-45f8-a19a-f71c8c6c0278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5", "tag": "90cfa8c9-1331-41ca-84e5-e5be3729e414"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:07.641729 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-0bc1818a-b6d8-4591-9513-d7c38e22ba3f req-21d587a2-9365-45f8-a19a-f71c8c6c0278 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:07.642166 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-0bc1818a-b6d8-4591-9513-d7c38e22ba3f req-21d587a2-9365-45f8-a19a-f71c8c6c0278 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:07.652755 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-0bc1818a-b6d8-4591-9513-d7c38e22ba3f req-21d587a2-9365-45f8-a19a-f71c8c6c0278 service nova] Creating event network-changed:90cfa8c9-1331-41ca-84e5-e5be3729e414 for instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 on hv-cinder-84164 May 13 13:05:07.658507 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-0bc1818a-b6d8-4591-9513-d7c38e22ba3f req-21d587a2-9365-45f8-a19a-f71c8c6c0278 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027593 May 13 13:05:07.659099 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 485/941] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:08.454306 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:08.455147 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:08.461236 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:08.461689 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:08.462463 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:08.462906 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:08.488534 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:05:08.561980 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-72dd83bf-714c-4a87-8343-2dada5970e54 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "DELETE /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 204 len: 0 microversion: 2.1 time: 0.111147 May 13 13:05:08.562490 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 457/942] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:05:08 2022] DELETE /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:05:08.572996 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:08.573955 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:08.580120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:08.580566 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:08.581354 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:08.581787 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:08.710801 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:08.718326 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-cd29c321-ec21-4b8b-b8da-cb4fec9111b1 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1552 microversion: 2.1 time: 0.151287 May 13 13:05:08.718897 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 486/943] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:08 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:09.737144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:09.737839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:09.743724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:09.744171 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:09.744937 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:09.745401 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:09.878196 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:09.885433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f2148a1b-3339-4dc7-a456-62c934ba39f9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1552 microversion: 2.1 time: 0.152704 May 13 13:05:09.885999 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 458/944] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:09 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:10.902969 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:10.903609 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:10.910487 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:10.910945 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:10.911983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:10.912564 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:11.044503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98724cc2db0e4404bbc71b3ae864ecfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7713dfabbe6446fac28d0b194ca627a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:11.051986 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ea58677e-388b-4021-b492-f9926fb4aec5 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 200 len: 1552 microversion: 2.1 time: 0.152860 May 13 13:05:11.052563 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 487/945] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:10 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:11.155974 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-f3504f9e-cca4-4c11-b605-54e63a2d60c8 req-96c2713e-194e-4343-9c42-3988bbfd7cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5", "name": "network-vif-deleted", "tag": "90cfa8c9-1331-41ca-84e5-e5be3729e414"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:11.167695 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-f3504f9e-cca4-4c11-b605-54e63a2d60c8 req-96c2713e-194e-4343-9c42-3988bbfd7cde service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:11.168142 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-f3504f9e-cca4-4c11-b605-54e63a2d60c8 req-96c2713e-194e-4343-9c42-3988bbfd7cde service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:11.180462 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-f3504f9e-cca4-4c11-b605-54e63a2d60c8 req-96c2713e-194e-4343-9c42-3988bbfd7cde service nova] Creating event network-vif-deleted:90cfa8c9-1331-41ca-84e5-e5be3729e414 for instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 on hv-cinder-84164 May 13 13:05:11.186034 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-f3504f9e-cca4-4c11-b605-54e63a2d60c8 req-96c2713e-194e-4343-9c42-3988bbfd7cde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033409 May 13 13:05:11.186637 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 459/946] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:12.069466 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:12.070077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] [instance: 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:12.076443 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:12.076893 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:12.077690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:12.078124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:12.090946 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] HTTP exception thrown: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 could not be found. May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Request method failure captured: May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 HTTP/1.1 May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflbpAUhYraEE18hvmJT6y-RsSG4e4dczCcisDcBG_v9acLUFctG489iVmIoXJIjiAqawV1kXhQCrmv1Wr7gqaOUxA1O1lu-S-PhZnXy8u4Ee54K00-29YjagtK02SZ2_t9xEq-Vj4sgvMqaUcXIZG0N13ubp1V9eWyW2BoNCeyr20vc May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: f7713dfabbe6446fac28d0b194ca627a May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-TestMinimumBasicScenario-1231245002 May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:05:12.092574 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f7713dfabbe6446fac28d0b194ca627a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f7713dfabbe6446fac28d0b194ca627a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f7713dfabbe6446fac28d0b194ca627a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f7713dfabbe6446fac28d0b194ca627a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-TestMinimumBasicScenario-1231245002 May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: f7713dfabbe6446fac28d0b194ca627a May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1231245002 May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-TestMinimumBasicScenario-1231245002-project May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 98724cc2db0e4404bbc71b3ae864ecfa May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-TestMinimumBasicScenario-1231245002-project May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 could not be found. May 13 13:05:12.094259 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5'} May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 could not be found. May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:05:12.095244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 could not be found. May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 could not be found. May 13 13:05:12.096913 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:12.098423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Returning 404 to user: Instance 24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:05:12.098423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-59dbcb53-8f44-4972-99ef-c41c4025a1c9 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5" status: 404 len: 111 microversion: 2.1 time: 0.028359 May 13 13:05:12.098423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 488/947] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:12 2022] GET /compute/v2.1/servers/24c9a0bb-7fb3-43a0-9175-b258e9c7bbd5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:05:12.103707 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-69fccf17-ba54-4d6c-aa9a-a4ac988ef070 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] Calling method '.version_select at 0x7f060213ab80>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:12.121160 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-69fccf17-ba54-4d6c-aa9a-a4ac988ef070 tempest-TestMinimumBasicScenario-1231245002 tempest-TestMinimumBasicScenario-1231245002-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-965017868" status: 202 len: 0 microversion: 2.1 time: 0.021791 May 13 13:05:12.121727 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 460/948] 10.222.0.49 () {58 vars in 1268 bytes} [Fri May 13 13:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-965017868 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:05:28.880468 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:28.881046 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:28.887113 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:28.887569 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:28.888339 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:28.888783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:28.914039 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:05:28.991511 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d45f1105-ffbd-4349-a10e-8fe66340ef02 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "DELETE /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 204 len: 0 microversion: 2.1 time: 0.114499 May 13 13:05:28.992465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 489/949] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:05:28 2022] DELETE /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:05:29.000757 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:29.001529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:29.007779 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:29.008233 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:29.009030 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:29.009473 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:29.138385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:29.145944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-632421e7-a9a0-4f87-ae39-c86e0f3c7d21 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1578 microversion: 2.1 time: 0.149525 May 13 13:05:29.146511 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 461/950] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:28 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:30.163877 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:30.164640 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:30.171554 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:30.172007 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:30.172800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:30.173267 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:30.310873 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:30.318482 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-99034773-6a22-4954-afdd-019ebcb24723 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1578 microversion: 2.1 time: 0.159120 May 13 13:05:30.319052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 490/951] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:30 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:31.335806 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:31.336536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:31.343484 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:31.343875 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:31.344726 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:31.345264 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:31.566082 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:31.573518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-592433c6-8fc4-4fbd-ab3a-d147c1b165a1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1578 microversion: 2.1 time: 0.241717 May 13 13:05:31.574091 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 462/952] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:31 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:31.798324 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-bfd8bd17-5c41-4ff7-8f1e-56ae7d0b6ad3 req-270904e0-95a8-40b4-a043-ac2fc9796c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949ac2a1-5fa1-458a-954b-09355d5dfc68", "name": "network-vif-deleted", "tag": "dc7acc83-6299-405b-9f2c-a8cefc650198"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:31.807418 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-bfd8bd17-5c41-4ff7-8f1e-56ae7d0b6ad3 req-270904e0-95a8-40b4-a043-ac2fc9796c10 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:31.808491 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-bfd8bd17-5c41-4ff7-8f1e-56ae7d0b6ad3 req-270904e0-95a8-40b4-a043-ac2fc9796c10 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:31.822979 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-bfd8bd17-5c41-4ff7-8f1e-56ae7d0b6ad3 req-270904e0-95a8-40b4-a043-ac2fc9796c10 service nova] Creating event network-vif-deleted:dc7acc83-6299-405b-9f2c-a8cefc650198 for instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 on hv-cinder-84164 May 13 13:05:31.828121 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-bfd8bd17-5c41-4ff7-8f1e-56ae7d0b6ad3 req-270904e0-95a8-40b4-a043-ac2fc9796c10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033270 May 13 13:05:31.828791 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 491/953] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:32.591019 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:32.591635 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:32.599290 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:32.599751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:32.600536 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:32.600972 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:32.636305 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:32.636752 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:32.637228 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lazy-loading 'fault' on Instance uuid 949ac2a1-5fa1-458a-954b-09355d5dfc68 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:05:32.680975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:32.687743 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1191bdde-6842-4f96-a090-fe10ecca9a19 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 200 len: 1184 microversion: 2.1 time: 0.100605 May 13 13:05:32.688311 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 463/954] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:32 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 1184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:33.704762 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:33.705509 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:33.712206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:33.712659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:33.713452 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:33.713890 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:33.727620 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] HTTP exception thrown: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Request method failure captured: May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 HTTP/1.1 May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflbnY7x2-dQX-sTiLuB20dfyciKoB-f9AllK-_lFbT49iMJ8qR-epMUty9UOMJXZWoSEqc2K5n9jyV8aN6hi_FPHJ3-KttOhSKDb9ojpQI7yXhRweBF58JJYjJY55U39YlT_4FocVtdZUQ1VRy7_0Iiu7bAHOcxvS4Pd593HvZS5P2U May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:05:33.729274 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a60c4cb84044c338d954f9a3ec8ef31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-TestVolumeBootPattern-1354158425 May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-TestVolumeBootPattern-1354158425-project May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 0956067c32cd476a8db7ee074f210700 May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-TestVolumeBootPattern-1354158425-project May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:05:33.731009 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '949ac2a1-5fa1-458a-954b-09355d5dfc68'} May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:05:33.732205 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:05:33.733820 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:05:33.735221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Returning 404 to user: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:05:33.735221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-4831af3e-6eb6-45f9-9b9d-1d747a82a871 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 404 len: 111 microversion: 2.1 time: 0.030612 May 13 13:05:33.735221 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 492/955] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:33 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:05:33.877234 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1164692690", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1219736643", "security_groups": [{"name": "tempest-secgroup-smoke-2036298892"}], "block_device_mapping_v2": [{"uuid": "63f732d7-0866-4e34-8030-2ce908967b41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aff18e0d-eb20-4ef6-a9a5-21ad8f6c2af1"}]}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:33.987319 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.network.neutron [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] validate_networks() for [('aff18e0d-eb20-4ef6-a9a5-21ad8f6c2af1', None, None, None, None, None)] {{(pid=123409) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:05:34.473483 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Flavor limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:05:34.473886 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Image limits 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:05:34.474385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Flavor pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:05:34.474792 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Image pref 0:0:0 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:05:34.475199 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.virt.hardware [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:05:34.483634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:34.484075 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:34.484871 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:34.485344 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:34.501817 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:05:34.506431 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.quota [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for user 0956067c32cd476a8db7ee074f210700 and project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'cores', 'instances', 'ram'} {{(pid=123409) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:05:34.562977 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Going to run 1 instances... {{(pid=123409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:05:34.565109 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63f732d7-0866-4e34-8030-2ce908967b41',volume_size=None,volume_type=None)] {{(pid=123409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:05:34.685226 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [c57da9f9-aed1-4129-96e3-642f6f0b6ed9] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 13:05:35.693405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO oslo.messaging._drivers.impl_rabbit [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [c57da9f9-aed1-4129-96e3-642f6f0b6ed9] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43836. May 13 13:05:35.697608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fa824eb2-faef-4ba2-a39d-11a1d6a6d452 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.824416 May 13 13:05:35.698261 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 464/956] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:05:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:05:35.709357 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-703e73b7-7d0d-4eb4-ba61-5d0ceea8d307 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:35.709976 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-703e73b7-7d0d-4eb4-ba61-5d0ceea8d307 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:35.762123 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-703e73b7-7d0d-4eb4-ba61-5d0ceea8d307 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:35.768553 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-703e73b7-7d0d-4eb4-ba61-5d0ceea8d307 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1095 microversion: 2.1 time: 0.063855 May 13 13:05:35.769124 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 493/957] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:35 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:36.787437 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-cc3f105d-3803-4fb7-9792-e55dd55d61d3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:36.787986 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-cc3f105d-3803-4fb7-9792-e55dd55d61d3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:36.839012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-cc3f105d-3803-4fb7-9792-e55dd55d61d3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:36.845457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-cc3f105d-3803-4fb7-9792-e55dd55d61d3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1095 microversion: 2.1 time: 0.063282 May 13 13:05:36.846016 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 465/958] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:36 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:37.862392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-21be8767-c4a7-47f7-b168-106f5c318bac tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:37.863059 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-21be8767-c4a7-47f7-b168-106f5c318bac tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:37.918441 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-21be8767-c4a7-47f7-b168-106f5c318bac tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:37.925005 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-21be8767-c4a7-47f7-b168-106f5c318bac tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1095 microversion: 2.1 time: 0.066382 May 13 13:05:37.925615 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 494/959] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:37 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:38.942029 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d9d7ee77-e0fc-42ef-bc68-e72f955414d2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:38.942714 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d9d7ee77-e0fc-42ef-bc68-e72f955414d2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:38.995834 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d9d7ee77-e0fc-42ef-bc68-e72f955414d2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:39.003229 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d9d7ee77-e0fc-42ef-bc68-e72f955414d2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1095 microversion: 2.1 time: 0.065374 May 13 13:05:39.003890 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 466/960] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:38 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:40.020776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:40.021427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:40.027776 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:40.028254 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:40.029052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:40.029494 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:40.090176 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:40.097850 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9dbe17b7-51bc-4b17-871b-7b681e93ccee tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1145 microversion: 2.1 time: 0.081459 May 13 13:05:40.098437 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 495/961] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:40 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:41.115122 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:41.115699 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:41.124064 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:41.124522 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:41.125347 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:41.125791 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:41.313430 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:41.322267 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-aefed8ac-f70c-4410-b430-ab1df27cbbdd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1211 microversion: 2.1 time: 0.211206 May 13 13:05:41.322859 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 467/962] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:41 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1211 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:42.339270 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:42.339774 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:42.348350 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:42.348851 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:42.349700 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:42.350135 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:42.529367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:42.538057 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-babb10ed-d3d5-4f21-8656-7472e2eea663 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.202583 May 13 13:05:42.538867 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 496/963] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:42 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:42.554546 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-2f81d2c5-e3aa-4a09-ae7c-4abc8f3e8b2c req-fb76704b-d3fa-4eaa-9a0f-1522a7e753a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd034d8-2288-42d6-b22e-6a197d659ca0", "tag": "f7c805ce-0b6a-4821-8d70-75759cd857d0"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:42.563134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-2f81d2c5-e3aa-4a09-ae7c-4abc8f3e8b2c req-fb76704b-d3fa-4eaa-9a0f-1522a7e753a7 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:42.563589 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-2f81d2c5-e3aa-4a09-ae7c-4abc8f3e8b2c req-fb76704b-d3fa-4eaa-9a0f-1522a7e753a7 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:42.575629 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-2f81d2c5-e3aa-4a09-ae7c-4abc8f3e8b2c req-fb76704b-d3fa-4eaa-9a0f-1522a7e753a7 service nova] Creating event network-changed:f7c805ce-0b6a-4821-8d70-75759cd857d0 for instance fbd034d8-2288-42d6-b22e-6a197d659ca0 on hv-cinder-84164 May 13 13:05:42.580632 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-2f81d2c5-e3aa-4a09-ae7c-4abc8f3e8b2c req-fb76704b-d3fa-4eaa-9a0f-1522a7e753a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176219 May 13 13:05:42.581280 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 468/964] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:05:43.556163 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:43.556801 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:43.563012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:43.563461 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:43.564225 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:43.564662 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:43.694071 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:43.701416 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-2d747e63-20a0-4868-a7a3-7ca33b2a3241 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.149131 May 13 13:05:43.701982 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 497/965] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:43 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:44.719539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:44.720247 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:44.727552 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:44.728013 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:44.728786 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:44.729255 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:44.857708 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:44.865748 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-20d2aac8-882f-4242-ac49-f79e2fcc1ffc tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.150917 May 13 13:05:44.866364 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 469/966] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:44 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:45.882794 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:45.883352 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:45.889331 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:45.889777 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:45.890542 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:45.890975 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:46.024693 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:46.032177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-81c57c53-bc3f-431a-98b3-76f675faf4f1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.153823 May 13 13:05:46.032766 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 498/967] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:45 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:47.049560 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:47.050118 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:47.056865 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:47.057356 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:47.058136 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:47.058613 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:47.190562 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:47.198170 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8ff79c96-aa29-466e-ae30-ecc06c2b31b0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.152428 May 13 13:05:47.198767 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 470/968] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:47 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:48.216502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:48.217187 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:48.223680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:48.224133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:48.224910 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:48.225380 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:48.353721 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:48.360999 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e4a085cf-6af9-40f0-bb65-a1c529a3b017 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.148546 May 13 13:05:48.361571 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 499/969] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:48 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:49.379007 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:49.379614 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:49.386015 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:49.386475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:49.387249 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:49.387688 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:49.523071 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:49.530362 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-75a8ad96-f69b-460c-b002-092aa3377b81 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.155897 May 13 13:05:49.530936 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 471/970] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:49 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:50.547397 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:50.547997 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:50.554787 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:50.555240 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:50.556012 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:50.556457 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:50.688185 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:50.696093 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b2ced655-0a3a-4334-a1b4-f06c0ff1821e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.152621 May 13 13:05:50.696865 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 500/971] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:50 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:51.712724 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:51.713372 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:51.719699 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:51.720151 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:51.720923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:51.721388 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:51.852558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:51.859975 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-c5dffcee-a1fc-4aac-896b-0698133f26ad tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.151159 May 13 13:05:51.860543 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 472/972] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:51 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:52.876777 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:52.877415 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:52.884920 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:52.885601 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:52.886651 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:52.887280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:53.287029 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:53.294251 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8c4d4d48-6d97-43d8-bc52-d9e7e5a2c9c2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.421515 May 13 13:05:53.294806 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 501/973] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:52 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:53.813736 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-e90e5eaa-5376-4acd-9a9a-5ac200d41109 req-f910d582-a81a-4e91-8378-80c61bfe4964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd034d8-2288-42d6-b22e-6a197d659ca0", "name": "network-vif-plugged", "status": "completed", "tag": "f7c805ce-0b6a-4821-8d70-75759cd857d0"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:53.822728 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-e90e5eaa-5376-4acd-9a9a-5ac200d41109 req-f910d582-a81a-4e91-8378-80c61bfe4964 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:53.823177 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-e90e5eaa-5376-4acd-9a9a-5ac200d41109 req-f910d582-a81a-4e91-8378-80c61bfe4964 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:53.833704 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-e90e5eaa-5376-4acd-9a9a-5ac200d41109 req-f910d582-a81a-4e91-8378-80c61bfe4964 service nova] Creating event network-vif-plugged:f7c805ce-0b6a-4821-8d70-75759cd857d0 for instance fbd034d8-2288-42d6-b22e-6a197d659ca0 on hv-cinder-84164 May 13 13:05:53.838682 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-e90e5eaa-5376-4acd-9a9a-5ac200d41109 req-f910d582-a81a-4e91-8378-80c61bfe4964 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085456 May 13 13:05:53.839293 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 473/974] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:05:54.311442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:54.312058 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:54.318623 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:54.319077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:54.319849 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:54.320288 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:54.455426 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:54.462795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fac7a4c5-c4b6-4956-be14-48fd6425de6d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.155301 May 13 13:05:54.463362 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 502/975] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:54 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:55.480433 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:55.495002 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:55.495002 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:55.495002 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:55.495002 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:55.495424 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:55.628833 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:55.636231 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1843b949-6187-40b2-827b-551f513b3bcf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1267 microversion: 2.1 time: 0.160162 May 13 13:05:55.636816 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 474/976] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:55 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:56.653201 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:56.653835 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:56.660806 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:56.661549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:56.662325 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:56.662770 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:56.792159 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:56.799486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f92da657-cee4-4e35-ba47-1497b37d5758 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1454 microversion: 2.1 time: 0.150225 May 13 13:05:56.800659 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 503/977] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:56 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:56.816387 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:05:56.817030 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:05:56.823252 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:56.823708 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:56.824471 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:56.824911 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:57.108134 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:05:57.115967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-7f24a606-b5ce-400f-a911-a83258689c42 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1454 microversion: 2.1 time: 0.303709 May 13 13:05:57.116529 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 475/978] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:05:56 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1454 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:05:58.958346 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-60a61b93-3c7f-4708-ba3e-d7f214ebf15a req-808ffed5-60c6-42d4-93a5-e7354d6a43b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd034d8-2288-42d6-b22e-6a197d659ca0", "tag": "f7c805ce-0b6a-4821-8d70-75759cd857d0"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:05:58.966748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-60a61b93-3c7f-4708-ba3e-d7f214ebf15a req-808ffed5-60c6-42d4-93a5-e7354d6a43b1 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:05:58.967195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-60a61b93-3c7f-4708-ba3e-d7f214ebf15a req-808ffed5-60c6-42d4-93a5-e7354d6a43b1 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:05:58.978654 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-60a61b93-3c7f-4708-ba3e-d7f214ebf15a req-808ffed5-60c6-42d4-93a5-e7354d6a43b1 service nova] Creating event network-changed:f7c805ce-0b6a-4821-8d70-75759cd857d0 for instance fbd034d8-2288-42d6-b22e-6a197d659ca0 on hv-cinder-84164 May 13 13:05:58.983752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-60a61b93-3c7f-4708-ba3e-d7f214ebf15a req-808ffed5-60c6-42d4-93a5-e7354d6a43b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029885 May 13 13:05:58.984583 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 504/979] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:07:01.263839 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:01.264383 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:01.270373 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:01.270827 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:01.271602 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:01.272045 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:01.294571 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.objects.instance [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lazy-loading 'flavor' on Instance uuid bd2b6382-3235-4869-8bda-65d55169a432 {{(pid=123409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:07:01.365988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-09e83d30-2cb5-4f2f-ab88-8e2a99651bd4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "POST /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432/action" status: 202 len: 0 microversion: 2.1 time: 0.106866 May 13 13:07:01.366568 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 476/980] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 13:07:01 2022] POST /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:07:01.376772 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:01.377520 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:01.383799 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:01.384388 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:01.385052 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:01.385496 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:01.515518 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:01.523549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c130514e-d780-4b71-86da-b2cb7264968b tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.152391 May 13 13:07:01.524114 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 505/981] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:01 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:02.541528 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:02.542269 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:02.548405 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:02.548861 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:02.549663 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:02.550114 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:02.678731 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:02.688422 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-61f99f8e-2a33-441a-9402-7438232e4ad3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.151922 May 13 13:07:02.689020 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 477/982] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:02 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:03.706097 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:03.706821 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:03.713811 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:03.714242 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:03.715017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:03.715490 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:03.847511 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:03.855423 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e97b864d-c232-4a49-bd9b-ae9ca247d6b9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.153274 May 13 13:07:03.856139 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 506/983] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:03 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:04.872824 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:04.873482 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:04.879998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:04.880457 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:04.881318 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:04.881764 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:05.009237 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:05.016617 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ae51be91-1759-4092-811a-52546e2e88a3 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.147746 May 13 13:07:05.017213 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 478/984] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:04 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:06.033533 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:06.034290 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:06.041515 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:06.041972 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:06.042752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:06.043192 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:06.169229 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:06.177224 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ae84d3bf-e19c-4df4-8e68-12edc9b3ad88 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.147573 May 13 13:07:06.177789 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 507/985] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:06 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:07.194459 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:07.195080 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:07.201492 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:07.201944 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:07.202731 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:07.203161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:07.333765 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:07.342264 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6ee4423c-b80e-4bcd-a835-58691031e5bb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.152206 May 13 13:07:07.342857 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 479/986] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:07 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:08.359684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:08.360280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:08.371765 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:08.372226 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:08.373030 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:08.373475 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:08.504708 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:08.512062 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-7db9ce3d-828e-445e-a1da-ddef59612796 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.156350 May 13 13:07:08.512664 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 508/987] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:08 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:09.529616 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:09.530226 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:09.536646 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:09.537127 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:09.537897 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:09.538334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:09.663575 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:09.670923 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-213cd4b5-36f2-4e58-960d-b2bcc596a7e5 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.145431 May 13 13:07:09.671663 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 480/988] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:09 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:10.688737 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:10.689382 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:10.695788 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:10.696241 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:10.697039 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:10.697483 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:10.825918 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:10.833858 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-66c07261-8fd5-458f-b7a5-535905c705a0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.149015 May 13 13:07:10.834424 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 509/989] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:10 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:11.851744 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:11.852369 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:11.858826 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:11.859282 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:11.860061 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:11.860502 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:12.057569 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:12.065012 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-4195feb9-9b0d-470e-9926-763e6ef177a9 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.217768 May 13 13:07:12.065683 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 481/990] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:11 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:13.081836 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:13.082489 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:13.088795 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:13.089281 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:13.090044 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:13.090479 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:13.218356 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:13.226275 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ca0277d5-d51b-4322-9ea7-c8b303cb36d6 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.148206 May 13 13:07:13.226779 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 510/991] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:13 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:14.242841 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:14.243391 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:14.249768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:14.250221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:14.251008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:14.251454 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:14.382409 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:14.390722 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6b798521-1d61-40c9-8e45-ec36f5ab538f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.152386 May 13 13:07:14.391292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 482/992] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:14 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:15.407573 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:15.408195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:15.415166 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:15.415622 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:15.416399 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:15.416837 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:15.546641 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:15.554145 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b960d6b0-0b5c-4bf7-86e0-5464b3013b92 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1510 microversion: 2.1 time: 0.150424 May 13 13:07:15.554723 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 511/993] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:15 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:15.570577 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-6284f6ac-97a6-493f-86cf-48d6af8870ad tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:15.571148 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-6284f6ac-97a6-493f-86cf-48d6af8870ad tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:15.577351 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6284f6ac-97a6-493f-86cf-48d6af8870ad tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:15.577806 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6284f6ac-97a6-493f-86cf-48d6af8870ad tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:15.578567 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6284f6ac-97a6-493f-86cf-48d6af8870ad tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:15.579007 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-6284f6ac-97a6-493f-86cf-48d6af8870ad tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:15.651397 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-6284f6ac-97a6-493f-86cf-48d6af8870ad tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "POST /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432/action" status: 202 len: 0 microversion: 2.1 time: 0.085282 May 13 13:07:15.652008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 483/994] 10.222.0.49 () {60 vars in 1277 bytes} [Fri May 13 13:07:15 2022] POST /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:07:15.659992 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:15.660527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:15.666550 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:15.667004 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:15.667923 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:15.668364 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:15.830596 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:15.838687 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-266b52ce-68ce-4599-8b9e-ca8831ade6e4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1518 microversion: 2.1 time: 0.182525 May 13 13:07:15.839265 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 512/995] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:15 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:16.855988 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:16.856665 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:16.862418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:16.862872 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:16.864250 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:16.864697 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:17.001396 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:17.010215 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-b9b19709-be87-4ba5-b1dd-939fcf5037eb tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1520 microversion: 2.1 time: 0.158692 May 13 13:07:17.010785 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 484/996] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:16 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:18.027670 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:18.028330 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:18.034812 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:18.035179 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:18.036939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:18.037409 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:18.162888 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-a0869f93-e4e8-45bb-82b2-1e0df4a2b873 req-00f2004e-c735-4f45-b107-8447f85c2a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2b6382-3235-4869-8bda-65d55169a432", "name": "network-vif-unplugged", "status": "completed", "tag": "afca9ad0-8e4f-4acb-801e-6a6d41ce806c"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:18.171416 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-a0869f93-e4e8-45bb-82b2-1e0df4a2b873 req-00f2004e-c735-4f45-b107-8447f85c2a0e service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:18.172416 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-a0869f93-e4e8-45bb-82b2-1e0df4a2b873 req-00f2004e-c735-4f45-b107-8447f85c2a0e service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:18.174635 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:18.183260 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-ac9bce16-35cd-4ef4-bab9-786edb1c0aaf tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1576 microversion: 2.1 time: 0.159441 May 13 13:07:18.184069 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 513/997] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:18 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:18.195082 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-a0869f93-e4e8-45bb-82b2-1e0df4a2b873 req-00f2004e-c735-4f45-b107-8447f85c2a0e service nova] Creating event network-vif-unplugged:afca9ad0-8e4f-4acb-801e-6a6d41ce806c for instance bd2b6382-3235-4869-8bda-65d55169a432 on hv-cinder-84164 May 13 13:07:18.200585 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-a0869f93-e4e8-45bb-82b2-1e0df4a2b873 req-00f2004e-c735-4f45-b107-8447f85c2a0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042164 May 13 13:07:18.201236 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 485/998] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:07:19.201728 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:19.202346 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:19.209668 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:19.210120 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:19.210898 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:19.211336 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:19.345068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:19.353144 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f365828c-874b-432a-875c-fc96e3613d99 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1576 microversion: 2.1 time: 0.155355 May 13 13:07:19.353717 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 514/999] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:19 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:20.371999 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:20.372582 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:20.378769 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:20.379835 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:20.380751 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:20.381219 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:20.511083 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:20.518447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-2ea19e2f-e65b-4742-934b-fc08542d8282 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1576 microversion: 2.1 time: 0.151563 May 13 13:07:20.519007 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 486/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:20 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:21.535478 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:21.536522 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:21.542513 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:21.542960 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:21.543722 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:21.544155 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:21.671791 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:21.679703 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-b8a8163f-f5f6-42de-a48f-e1e6342a7809 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1576 microversion: 2.1 time: 0.148421 May 13 13:07:21.680268 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 515/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:21 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:22.697025 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:22.697676 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:22.703993 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:22.704446 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:22.705273 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:22.705720 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:22.836223 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:22.843539 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-8f931dc0-6c4c-4373-89f4-c6b079483533 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1576 microversion: 2.1 time: 0.150422 May 13 13:07:22.844102 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 487/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:22 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:23.860800 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:23.861432 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:23.868407 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:23.868856 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:23.869715 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:23.870151 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:23.998480 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:24.006679 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-9817c952-3991-44a7-a63a-bca02946a1c0 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1576 microversion: 2.1 time: 0.149754 May 13 13:07:24.007247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 516/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:23 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:25.023849 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:25.024462 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:25.030897 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:25.031353 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:25.032166 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:25.032610 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:25.160348 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:25.168601 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-db44b560-bc26-40ac-9be5-b8145f26cb87 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1576 microversion: 2.1 time: 0.149261 May 13 13:07:25.169199 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 488/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:25 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:25.749309 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:07:25.749895 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Fri May 13 13:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:07:26.186684 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:26.187294 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:26.194219 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:26.194673 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:26.195439 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:26.195877 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:26.344299 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:26.354107 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-f6546b14-04c3-456c-93d1-dc1c25f76362 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1563 microversion: 2.1 time: 0.171290 May 13 13:07:26.354695 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 517/1005] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:26 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:29.645610 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-7d17ce59-63a2-44cf-bd9e-0d07366390c9 req-0ce0ff07-40ed-4d8d-b699-4475bd5634c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2b6382-3235-4869-8bda-65d55169a432", "name": "network-vif-plugged", "status": "completed", "tag": "afca9ad0-8e4f-4acb-801e-6a6d41ce806c"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:29.654713 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7d17ce59-63a2-44cf-bd9e-0d07366390c9 req-0ce0ff07-40ed-4d8d-b699-4475bd5634c9 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:29.655154 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-7d17ce59-63a2-44cf-bd9e-0d07366390c9 req-0ce0ff07-40ed-4d8d-b699-4475bd5634c9 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:29.667638 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-7d17ce59-63a2-44cf-bd9e-0d07366390c9 req-0ce0ff07-40ed-4d8d-b699-4475bd5634c9 service nova] Creating event network-vif-plugged:afca9ad0-8e4f-4acb-801e-6a6d41ce806c for instance bd2b6382-3235-4869-8bda-65d55169a432 on hv-cinder-84164 May 13 13:07:29.672661 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-7d17ce59-63a2-44cf-bd9e-0d07366390c9 req-0ce0ff07-40ed-4d8d-b699-4475bd5634c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 May 13 13:07:29.673282 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 489/1006] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:07:34.285944 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-73314016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1219736643", "security_groups": [{"name": "tempest-secgroup-smoke-2036298892"}], "block_device_mapping_v2": [{"uuid": "9a663fe6-b6c5-4827-8196-b5e1fffa9e25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aff18e0d-eb20-4ef6-a9a5-21ad8f6c2af1"}]}} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:34.393733 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.network.neutron [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] validate_networks() for [('aff18e0d-eb20-4ef6-a9a5-21ad8f6c2af1', None, None, None, None, None)] {{(pid=123410) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:07:34.813017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Flavor limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:07:34.813442 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Image limits 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:07:34.813919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Flavor pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:07:34.814328 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Image pref 0:0:0 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:07:34.814738 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.virt.hardware [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:07:34.823296 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:34.823740 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:34.824539 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:34.824972 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:34.841194 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:07:34.845011 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.quota [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Getting quotas for user 0956067c32cd476a8db7ee074f210700 and project 6a60c4cb84044c338d954f9a3ec8ef31. Resources: {'cores', 'instances', 'ram'} {{(pid=123410) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:07:34.903068 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Going to run 1 instances... {{(pid=123410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:07:34.905247 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a663fe6-b6c5-4827-8196-b5e1fffa9e25',volume_size=None,volume_type=None)] {{(pid=123410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:07:35.030760 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-d694b3db-3722-4a91-8da4-4ac59b13b5d7 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748628 May 13 13:07:35.031408 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 518/1007] 10.222.0.49 () {60 vars in 1146 bytes} [Fri May 13 13:07:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:07:35.042766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0753af48-76ce-472e-b0c1-5eee277134a0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:35.043477 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0753af48-76ce-472e-b0c1-5eee277134a0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:35.096942 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0753af48-76ce-472e-b0c1-5eee277134a0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:35.103629 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0753af48-76ce-472e-b0c1-5eee277134a0 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1093 microversion: 2.1 time: 0.065528 May 13 13:07:35.104193 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 490/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:35 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:36.120583 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:36.121314 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:36.128118 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:36.128576 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:36.129446 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:36.130459 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:36.197280 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:36.205001 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-e6c2b561-9d9d-47b6-9aee-acb51864372e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1209 microversion: 2.1 time: 0.088737 May 13 13:07:36.205572 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 519/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:36 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:37.221788 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:37.222464 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:37.230112 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:37.230558 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:37.231325 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:37.231764 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:37.436894 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:37.445271 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ad25712d-6d85-47fe-8628-7957e2220e79 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.227348 May 13 13:07:37.445838 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 491/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:37 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:37.560939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-3c3f0217-e187-4859-a4f1-226437b7e0d2 req-3819a88b-28b2-4e8b-99c4-3bc834b72b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5f200f-f7a3-485e-959c-aaccf80da0c2", "tag": "498fb071-20ff-4d6e-b0a8-f6eacf67a6f5"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:37.569770 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-3c3f0217-e187-4859-a4f1-226437b7e0d2 req-3819a88b-28b2-4e8b-99c4-3bc834b72b89 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:37.570635 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-3c3f0217-e187-4859-a4f1-226437b7e0d2 req-3819a88b-28b2-4e8b-99c4-3bc834b72b89 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:37.585993 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-3c3f0217-e187-4859-a4f1-226437b7e0d2 req-3819a88b-28b2-4e8b-99c4-3bc834b72b89 service nova] Creating event network-changed:498fb071-20ff-4d6e-b0a8-f6eacf67a6f5 for instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 on hv-cinder-84164 May 13 13:07:37.591835 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-3c3f0217-e187-4859-a4f1-226437b7e0d2 req-3819a88b-28b2-4e8b-99c4-3bc834b72b89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036088 May 13 13:07:37.592448 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 520/1011] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:07:38.462709 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:38.463965 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:38.470161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:38.470962 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:38.471761 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:38.472377 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:39.020537 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:39.028608 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-1e91f7ab-0233-40ab-affa-1ad428c7f1b2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.570717 May 13 13:07:39.029230 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 492/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:38 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:40.046799 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:40.047501 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:40.054486 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:40.054939 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:40.055698 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:40.056129 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:40.185198 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:40.193181 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8b8b0219-ab51-4222-9925-44c74b1c3761 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.150449 May 13 13:07:40.193752 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 521/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:40 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:41.210837 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:41.211451 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:41.217788 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:41.218246 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:41.219014 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:41.219462 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:41.351233 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:41.358851 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fe1e9ad8-799f-4b36-8c7e-783fab424d96 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.152917 May 13 13:07:41.359418 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 493/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:41 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:42.375705 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:42.376246 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:42.382680 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:42.383138 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:42.383915 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:42.384358 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:42.513567 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:42.521315 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1991747c-45ea-4524-a105-5c408764e72b tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.149544 May 13 13:07:42.521861 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 522/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:42 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:43.538853 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:43.539469 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:43.545914 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:43.546368 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:43.547143 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:43.547580 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:43.673034 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:43.680854 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-d0e8e5e0-3714-4ed9-a434-338483f1e4d8 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.146321 May 13 13:07:43.681445 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 494/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:43 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:44.697206 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:44.697821 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:44.704098 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:44.704549 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:44.705367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:44.705803 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:44.832174 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:44.839577 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-5df0cb4b-ddd4-4e45-9d8a-4bf57cad9b25 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.146771 May 13 13:07:44.840427 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 523/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:44 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:45.862768 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:45.863334 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:45.869672 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:45.870117 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:45.870882 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:45.871321 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:46.001880 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:46.009996 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-815e7102-26d6-46d6-92ca-211285a5baf3 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.151109 May 13 13:07:46.010567 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 495/1018] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:45 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:47.027688 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:47.028232 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:47.034625 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:47.035076 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:47.035850 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:47.036540 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:47.171805 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:47.179367 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-38fd0e69-627b-4a93-b50c-34133d26b1e1 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.155840 May 13 13:07:47.180273 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 524/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:47 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:48.196792 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:48.197447 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:48.203785 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:48.204221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:48.205002 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:48.205461 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:48.335953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:48.343329 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-df25c272-a742-44c9-bf9e-168c516888df tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.151140 May 13 13:07:48.343907 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 496/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:48 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:48.636171 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-d3f8c891-8a37-41f1-8562-7b1c693325c5 req-864d3978-43b8-42a6-9a36-6445285f016f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5f200f-f7a3-485e-959c-aaccf80da0c2", "name": "network-vif-plugged", "status": "completed", "tag": "498fb071-20ff-4d6e-b0a8-f6eacf67a6f5"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:48.645818 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-d3f8c891-8a37-41f1-8562-7b1c693325c5 req-864d3978-43b8-42a6-9a36-6445285f016f service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:48.647177 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-d3f8c891-8a37-41f1-8562-7b1c693325c5 req-864d3978-43b8-42a6-9a36-6445285f016f service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:48.659925 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-d3f8c891-8a37-41f1-8562-7b1c693325c5 req-864d3978-43b8-42a6-9a36-6445285f016f service nova] Creating event network-vif-plugged:498fb071-20ff-4d6e-b0a8-f6eacf67a6f5 for instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 on hv-cinder-84164 May 13 13:07:48.666207 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-d3f8c891-8a37-41f1-8562-7b1c693325c5 req-864d3978-43b8-42a6-9a36-6445285f016f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033581 May 13 13:07:48.667503 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 525/1021] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:07:49.360511 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:49.361112 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:49.368365 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:49.368820 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:49.369632 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:49.370077 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:49.497240 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:49.504413 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-0b9cb8e0-a3ea-4157-ac03-b2cb5bb4a208 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1265 microversion: 2.1 time: 0.147890 May 13 13:07:49.504973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 497/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:49 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:50.523040 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:50.523828 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:50.530307 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:50.530769 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:50.531555 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:50.532002 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:50.672528 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:50.680428 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-23447239-0bc9-43bb-9990-ec60517d6f26 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1452 microversion: 2.1 time: 0.162432 May 13 13:07:50.681015 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 526/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:50 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:50.697285 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:07:50.697967 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:07:50.704303 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:50.704766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:50.705567 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:50.706016 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:50.832566 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:07:50.840063 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-17f362bb-1bd8-486a-a08e-944f2ca3563d tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1452 microversion: 2.1 time: 0.147465 May 13 13:07:50.840634 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 498/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:07:50 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:07:52.439433 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-9533f94f-3bc8-46ca-bd99-6bf1c16016cb req-35143fe4-9fae-4bd5-b611-990e505b06d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5f200f-f7a3-485e-959c-aaccf80da0c2", "tag": "498fb071-20ff-4d6e-b0a8-f6eacf67a6f5"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:07:52.449228 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9533f94f-3bc8-46ca-bd99-6bf1c16016cb req-35143fe4-9fae-4bd5-b611-990e505b06d2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:07:52.449683 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-9533f94f-3bc8-46ca-bd99-6bf1c16016cb req-35143fe4-9fae-4bd5-b611-990e505b06d2 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:07:52.463921 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-9533f94f-3bc8-46ca-bd99-6bf1c16016cb req-35143fe4-9fae-4bd5-b611-990e505b06d2 service nova] Creating event network-changed:498fb071-20ff-4d6e-b0a8-f6eacf67a6f5 for instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 on hv-cinder-84164 May 13 13:07:52.469348 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-9533f94f-3bc8-46ca-bd99-6bf1c16016cb req-35143fe4-9fae-4bd5-b611-990e505b06d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033376 May 13 13:07:52.469950 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 527/1025] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:07:57.040109 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:07:57.040592 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Fri May 13 13:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:08:43.147452 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:08:43.148090 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:08:43.151057 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-709bfb88-841e-4c85-8435-6b00dfbd9ec1 req-5a0027a4-f73c-4850-9523-caa3924b7750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2b6382-3235-4869-8bda-65d55169a432", "tag": "afca9ad0-8e4f-4acb-801e-6a6d41ce806c"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:08:43.155159 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:43.155694 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:43.156590 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:43.157278 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:43.160374 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-709bfb88-841e-4c85-8435-6b00dfbd9ec1 req-5a0027a4-f73c-4850-9523-caa3924b7750 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:43.160823 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-709bfb88-841e-4c85-8435-6b00dfbd9ec1 req-5a0027a4-f73c-4850-9523-caa3924b7750 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:43.172859 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-709bfb88-841e-4c85-8435-6b00dfbd9ec1 req-5a0027a4-f73c-4850-9523-caa3924b7750 service nova] Creating event network-changed:afca9ad0-8e4f-4acb-801e-6a6d41ce806c for instance bd2b6382-3235-4869-8bda-65d55169a432 on hv-cinder-84164 May 13 13:08:43.178022 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-709bfb88-841e-4c85-8435-6b00dfbd9ec1 req-5a0027a4-f73c-4850-9523-caa3924b7750 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032016 May 13 13:08:43.178934 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 528/1026] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:08:43.186153 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Going to try to terminate instance {{(pid=123409) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:08:43.276851 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-a1e0c329-73c6-4336-9d40-03a028e39eb1 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 204 len: 0 microversion: 2.1 time: 0.133085 May 13 13:08:43.277822 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 499/1027] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:08:43 2022] DELETE /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:08:43.287110 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:08:43.287771 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:08:43.295304 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:43.295763 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:43.296802 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:43.297289 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:43.434440 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:08:43.441878 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-8d6890ce-c421-4553-9ecf-1c7c2d18cae4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.159503 May 13 13:08:43.442455 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 529/1028] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:08:43 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:08:44.460259 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:08:44.461098 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:08:44.467953 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:44.468400 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:44.469210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:44.469652 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:44.660998 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:08:44.668666 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-ed6af83e-6b7b-47ef-96aa-6739bbfecfc4 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1569 microversion: 2.1 time: 0.212614 May 13 13:08:44.669276 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 500/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:08:44 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:08:45.687438 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:08:45.688208 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:08:45.695603 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:45.696085 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:45.696869 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:45.697406 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:45.760072 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-e2aa4765-fcc7-4e45-aa0c-fd0c382e4a3a req-b24aefeb-7276-461b-86ec-aca26a40870f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2b6382-3235-4869-8bda-65d55169a432", "name": "network-vif-deleted", "tag": "afca9ad0-8e4f-4acb-801e-6a6d41ce806c"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:08:45.769674 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-e2aa4765-fcc7-4e45-aa0c-fd0c382e4a3a req-b24aefeb-7276-461b-86ec-aca26a40870f service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:45.770135 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-e2aa4765-fcc7-4e45-aa0c-fd0c382e4a3a req-b24aefeb-7276-461b-86ec-aca26a40870f service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:45.771356 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9be8bbb7804f4f9d170d11636484e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd43e74ace585434482a887caf9d61c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:08:45.780165 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-fdcb2b78-1620-4c8d-a963-6453469f5a6f tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 200 len: 1383 microversion: 2.1 time: 0.096752 May 13 13:08:45.781033 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 530/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:08:45 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 1383 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:08:45.782210 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-e2aa4765-fcc7-4e45-aa0c-fd0c382e4a3a req-b24aefeb-7276-461b-86ec-aca26a40870f service nova] Creating event network-vif-deleted:afca9ad0-8e4f-4acb-801e-6a6d41ce806c for instance bd2b6382-3235-4869-8bda-65d55169a432 on hv-cinder-84164 May 13 13:08:45.787194 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-e2aa4765-fcc7-4e45-aa0c-fd0c382e4a3a req-b24aefeb-7276-461b-86ec-aca26a40870f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090385 May 13 13:08:45.787931 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 501/1031] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:08:46.798244 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:08:46.798855 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] [instance: bd2b6382-3235-4869-8bda-65d55169a432] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:08:46.805089 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:46.805588 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:46.806403 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:08:46.806957 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:08:46.820222 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] HTTP exception thrown: Instance bd2b6382-3235-4869-8bda-65d55169a432 could not be found. May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Request method failure captured: May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 HTTP/1.1 May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABifldV64-aymjAiW1Fc7zKstsWg_Kdd1dYFs6hIIdrySLCJ23O8pVXgDSXFueaDEkVt84YZlZzAVTQDmGnpUH27YFVKtPwcPTZk2VDgGrzGTEeMm5Y1BVpZiKHOHqmUHWLfiF4Md7cGgQ7MlIbObufPxUGRUFCyz_NGkGSDyQX_QQ8GJQ May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: d43e74ace585434482a887caf9d61c9f May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-TestShelveInstance-47833361 May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:08:46.821919 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d43e74ace585434482a887caf9d61c9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d43e74ace585434482a887caf9d61c9f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d43e74ace585434482a887caf9d61c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d43e74ace585434482a887caf9d61c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-TestShelveInstance-47833361 May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: d43e74ace585434482a887caf9d61c9f May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-TestShelveInstance-47833361 May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-TestShelveInstance-47833361-project May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 1d9be8bbb7804f4f9d170d11636484e1 May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-TestShelveInstance-47833361-project May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance bd2b6382-3235-4869-8bda-65d55169a432 could not be found. May 13 13:08:46.823565 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': 'bd2b6382-3235-4869-8bda-65d55169a432'} May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2b6382-3235-4869-8bda-65d55169a432 could not be found. May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:08:46.824392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2b6382-3235-4869-8bda-65d55169a432 could not be found. May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2b6382-3235-4869-8bda-65d55169a432 could not be found. May 13 13:08:46.826340 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:08:46.827834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Returning 404 to user: Instance bd2b6382-3235-4869-8bda-65d55169a432 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:08:46.827834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-6e877add-cdde-4477-a429-3bc71369da18 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432" status: 404 len: 111 microversion: 2.1 time: 0.029148 May 13 13:08:46.827834 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 531/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:08:46 2022] GET /compute/v2.1/servers/bd2b6382-3235-4869-8bda-65d55169a432 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:08:46.988116 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-bd13e18f-4e06-4856-88e1-c691232cb016 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] Calling method '.version_select at 0x7f0601eb18b0>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:08:47.009326 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-bd13e18f-4e06-4856-88e1-c691232cb016 tempest-TestShelveInstance-47833361 tempest-TestShelveInstance-47833361-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1193000797" status: 202 len: 0 microversion: 2.1 time: 0.025824 May 13 13:08:47.010852 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 502/1033] 10.222.0.49 () {58 vars in 1253 bytes} [Fri May 13 13:08:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1193000797 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:09:21.332169 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:21.332685 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:21.336111 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-db11b518-bb36-4657-a365-6aa0211e0ba2 req-fcf170be-8c5a-497a-9275-2e722be79cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5f200f-f7a3-485e-959c-aaccf80da0c2", "tag": "498fb071-20ff-4d6e-b0a8-f6eacf67a6f5"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:09:21.339077 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:21.340368 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:21.341392 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:21.342031 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:21.345266 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-db11b518-bb36-4657-a365-6aa0211e0ba2 req-fcf170be-8c5a-497a-9275-2e722be79cae service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:21.345709 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-db11b518-bb36-4657-a365-6aa0211e0ba2 req-fcf170be-8c5a-497a-9275-2e722be79cae service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:21.356295 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-db11b518-bb36-4657-a365-6aa0211e0ba2 req-fcf170be-8c5a-497a-9275-2e722be79cae service nova] Creating event network-changed:498fb071-20ff-4d6e-b0a8-f6eacf67a6f5 for instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 on hv-cinder-84164 May 13 13:09:21.362173 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-db11b518-bb36-4657-a365-6aa0211e0ba2 req-fcf170be-8c5a-497a-9275-2e722be79cae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030136 May 13 13:09:21.363197 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 503/1034] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:09:21.370983 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:09:21.454690 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-0ae2fae3-e8be-4b88-8492-2d737d24cdb4 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 204 len: 0 microversion: 2.1 time: 0.126235 May 13 13:09:21.455564 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 532/1035] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:09:21 2022] DELETE /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:09:21.466739 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:21.467620 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:21.475864 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:21.476420 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:21.477235 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:21.477675 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:21.619107 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:09:21.627343 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-347fe985-9a81-4b4f-8fd0-2fbfbe9cb037 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1577 microversion: 2.1 time: 0.166922 May 13 13:09:21.627918 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 504/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:21 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:09:22.645857 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:22.646594 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:22.653566 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:22.654017 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:22.654783 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:22.655225 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:22.782987 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:09:22.790558 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-c2e0001d-92bc-4133-93a3-dc9603a33edd tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1577 microversion: 2.1 time: 0.148980 May 13 13:09:22.791133 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 533/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:22 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:09:23.808221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:23.809124 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:23.815330 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:23.815781 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:23.816556 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:23.817002 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:23.906935 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:09:23.914614 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-416cf1fe-b389-431a-b239-3dcc4c849eeb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 200 len: 1390 microversion: 2.1 time: 0.110844 May 13 13:09:23.915385 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 505/1038] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:23 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 1390 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:09:23.938815 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [req-e0c2a7b5-84ba-4112-b4ca-e0c809fc3c63 req-0d30ceb7-dd8d-4bce-b094-379df3c64c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5f200f-f7a3-485e-959c-aaccf80da0c2", "name": "network-vif-deleted", "tag": "498fb071-20ff-4d6e-b0a8-f6eacf67a6f5"}]} {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:09:23.947359 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e0c2a7b5-84ba-4112-b4ca-e0c809fc3c63 req-0d30ceb7-dd8d-4bce-b094-379df3c64c71 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:23.947817 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [req-e0c2a7b5-84ba-4112-b4ca-e0c809fc3c63 req-0d30ceb7-dd8d-4bce-b094-379df3c64c71 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:23.961875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.compute.server_external_events [req-e0c2a7b5-84ba-4112-b4ca-e0c809fc3c63 req-0d30ceb7-dd8d-4bce-b094-379df3c64c71 service nova] Creating event network-vif-deleted:498fb071-20ff-4d6e-b0a8-f6eacf67a6f5 for instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 on hv-cinder-84164 May 13 13:09:23.968875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [req-e0c2a7b5-84ba-4112-b4ca-e0c809fc3c63 req-0d30ceb7-dd8d-4bce-b094-379df3c64c71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033677 May 13 13:09:23.969868 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 534/1039] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:09:24.931581 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:24.932176 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 9c5f200f-f7a3-485e-959c-aaccf80da0c2] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:24.939700 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:24.940288 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:24.941113 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:24.941554 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:24.954766 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] HTTP exception thrown: Instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 could not be found. May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Request method failure captured: May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 HTTP/1.1 May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflbnY7x2-dQX-sTiLuB20dfyciKoB-f9AllK-_lFbT49iMJ8qR-epMUty9UOMJXZWoSEqc2K5n9jyV8aN6hi_FPHJ3-KttOhSKDb9ojpQI7yXhRweBF58JJYjJY55U39YlT_4FocVtdZUQ1VRy7_0Iiu7bAHOcxvS4Pd593HvZS5P2U May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:09:24.956425 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a60c4cb84044c338d954f9a3ec8ef31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 0956067c32cd476a8db7ee074f210700 May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 could not be found. May 13 13:09:24.958221 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '9c5f200f-f7a3-485e-959c-aaccf80da0c2'} May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 could not be found. May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:09:24.959286 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 could not be found. May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 could not be found. May 13 13:09:24.960973 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:24.962544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Returning 404 to user: Instance 9c5f200f-f7a3-485e-959c-aaccf80da0c2 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:09:24.962544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-dfd0b961-7dfc-400f-98c2-b48282e32e3f tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2" status: 404 len: 111 microversion: 2.1 time: 0.030196 May 13 13:09:24.962544 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 506/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:24 2022] GET /compute/v2.1/servers/9c5f200f-f7a3-485e-959c-aaccf80da0c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:09:28.035502 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:28.036167 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:28.037326 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-99818d41-03df-4f85-88bf-58272c6ab5f8 req-f341e453-72c3-4c7f-b78d-c02dfe0de16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd034d8-2288-42d6-b22e-6a197d659ca0", "tag": "f7c805ce-0b6a-4821-8d70-75759cd857d0"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:09:28.043230 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:28.043748 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:28.044875 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:28.045670 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:28.045937 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-99818d41-03df-4f85-88bf-58272c6ab5f8 req-f341e453-72c3-4c7f-b78d-c02dfe0de16c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:28.046390 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-99818d41-03df-4f85-88bf-58272c6ab5f8 req-f341e453-72c3-4c7f-b78d-c02dfe0de16c service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:28.057587 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-99818d41-03df-4f85-88bf-58272c6ab5f8 req-f341e453-72c3-4c7f-b78d-c02dfe0de16c service nova] Creating event network-changed:f7c805ce-0b6a-4821-8d70-75759cd857d0 for instance fbd034d8-2288-42d6-b22e-6a197d659ca0 on hv-cinder-84164 May 13 13:09:28.064062 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-99818d41-03df-4f85-88bf-58272c6ab5f8 req-f341e453-72c3-4c7f-b78d-c02dfe0de16c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030904 May 13 13:09:28.065299 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 507/1041] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:09:28.077157 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Going to try to terminate instance {{(pid=123410) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:09:28.162016 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-1236092a-9807-48f3-9a68-a78ca6e2ee58 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 204 len: 0 microversion: 2.1 time: 0.130003 May 13 13:09:28.166195 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 535/1042] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:09:28 2022] DELETE /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:09:28.173323 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:28.174801 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:28.180532 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:28.181008 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:28.181785 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:28.182224 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:28.562475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.policy [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123409) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:09:28.570874 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f573f3e4-cdb5-412f-ac1b-dca6c51bebdf tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1579 microversion: 2.1 time: 0.402656 May 13 13:09:28.571464 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 508/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:28 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1579 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:09:29.588252 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:29.588880 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:29.595265 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:29.595720 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:29.596505 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:29.596948 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:29.781781 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:09:29.789474 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-47b8d287-1e6a-4504-a396-6903313f34e2 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1579 microversion: 2.1 time: 0.205500 May 13 13:09:29.790046 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 536/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:29 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1579 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:09:30.605804 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [req-e1517d18-ca03-4add-b0bb-097e1a5efa60 req-52a11cec-a772-4227-b2a4-ba4d1786bac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd034d8-2288-42d6-b22e-6a197d659ca0", "name": "network-vif-deleted", "tag": "f7c805ce-0b6a-4821-8d70-75759cd857d0"}]} {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:09:30.614323 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-e1517d18-ca03-4add-b0bb-097e1a5efa60 req-52a11cec-a772-4227-b2a4-ba4d1786bac8 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:30.614805 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [req-e1517d18-ca03-4add-b0bb-097e1a5efa60 req-52a11cec-a772-4227-b2a4-ba4d1786bac8 service nova] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:30.626515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.compute.server_external_events [req-e1517d18-ca03-4add-b0bb-097e1a5efa60 req-52a11cec-a772-4227-b2a4-ba4d1786bac8 service nova] Creating event network-vif-deleted:f7c805ce-0b6a-4821-8d70-75759cd857d0 for instance fbd034d8-2288-42d6-b22e-6a197d659ca0 on hv-cinder-84164 May 13 13:09:30.631494 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [req-e1517d18-ca03-4add-b0bb-097e1a5efa60 req-52a11cec-a772-4227-b2a4-ba4d1786bac8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029278 May 13 13:09:30.632101 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 509/1045] 10.222.0.49 () {64 vars in 1317 bytes} [Fri May 13 13:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:09:30.807025 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:30.807568 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:30.813972 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:30.814388 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:30.815158 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:30.815602 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:30.881078 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.policy [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0956067c32cd476a8db7ee074f210700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a60c4cb84044c338d954f9a3ec8ef31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123410) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:09:30.890004 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-873c618d-992b-4c4e-8ae6-3cf9c718237e tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 200 len: 1226 microversion: 2.1 time: 0.086847 May 13 13:09:30.890708 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 537/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:30 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:09:31.907786 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:31.908487 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: fbd034d8-2288-42d6-b22e-6a197d659ca0] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:31.914866 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:31.915317 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:31.916082 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:31.916518 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:31.929856 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] HTTP exception thrown: Instance fbd034d8-2288-42d6-b22e-6a197d659ca0 could not be found. May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Request method failure captured: May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 HTTP/1.1 May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflbnY7x2-dQX-sTiLuB20dfyciKoB-f9AllK-_lFbT49iMJ8qR-epMUty9UOMJXZWoSEqc2K5n9jyV8aN6hi_FPHJ3-KttOhSKDb9ojpQI7yXhRweBF58JJYjJY55U39YlT_4FocVtdZUQ1VRy7_0Iiu7bAHOcxvS4Pd593HvZS5P2U May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:09:31.931475 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a60c4cb84044c338d954f9a3ec8ef31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 0956067c32cd476a8db7ee074f210700 May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance fbd034d8-2288-42d6-b22e-6a197d659ca0 could not be found. May 13 13:09:31.933315 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': 'fbd034d8-2288-42d6-b22e-6a197d659ca0'} May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbd034d8-2288-42d6-b22e-6a197d659ca0 could not be found. May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:09:31.934144 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd034d8-2288-42d6-b22e-6a197d659ca0 could not be found. May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd034d8-2288-42d6-b22e-6a197d659ca0 could not be found. May 13 13:09:31.935928 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:31.937188 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Returning 404 to user: Instance fbd034d8-2288-42d6-b22e-6a197d659ca0 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:09:31.937188 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-fd1541b7-af22-4362-80ff-8327482c22e9 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0" status: 404 len: 111 microversion: 2.1 time: 0.029894 May 13 13:09:31.937188 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 510/1047] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:31 2022] GET /compute/v2.1/servers/fbd034d8-2288-42d6-b22e-6a197d659ca0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:09:32.370847 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:32.371369 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.compute.api [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123410) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:32.378520 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:32.378980 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:32.379755 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:32.380209 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG oslo_concurrency.lockutils [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:32.393284 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.wsgi [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] HTTP exception thrown: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Request method failure captured: May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: request: DELETE /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 HTTP/1.1 May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept: application/json May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Accept-Encoding: identity May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Connection: close May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Length: 0 May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Content-Type: application/json May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Host: 10.222.0.49 May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Openstack-System-Scope: None May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: User-Agent: python-urllib3/1.26.9 May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Auth-Token: gAAAAABiflbnY7x2-dQX-sTiLuB20dfyciKoB-f9AllK-_lFbT49iMJ8qR-epMUty9UOMJXZWoSEqc2K5n9jyV8aN6hi_FPHJ3-KttOhSKDb9ojpQI7yXhRweBF58JJYjJY55U39YlT_4FocVtdZUQ1VRy7_0Iiu7bAHOcxvS4Pd593HvZS5P2U May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Id: None May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Domain-Name: None May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Identity-Status: Confirmed May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Is-Admin-Project: True May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Id: default May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Domain-Name: Default May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Project-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Role: reader,member May 13 13:09:32.394942 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Roles: reader,member May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a60c4cb84044c338d954f9a3ec8ef31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Id: default May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Domain-Name: Default May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Id: 0956067c32cd476a8db7ee074f210700 May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: X-User-Name: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: method: > May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: exception: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.396527 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: action_args: {'id': '949ac2a1-5fa1-458a-954b-09355d5dfc68'} May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:09:32.397504 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.399019 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: ERROR nova.api.openstack.wsgi May 13 13:09:32.400537 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Returning 404 to user: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. {{(pid=123410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:09:32.400537 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-76d370e1-9de4-48bb-a3fb-45d1512e5aa5 tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "DELETE /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 404 len: 111 microversion: 2.1 time: 0.029521 May 13 13:09:32.400537 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 538/1048] 10.222.0.49 () {58 vars in 1238 bytes} [Fri May 13 13:09:32 2022] DELETE /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:09:32.405328 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '>' {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:32.405939 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.compute.api [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] [instance: 949ac2a1-5fa1-458a-954b-09355d5dfc68] Fetching instance by UUID {{(pid=123409) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:09:32.411987 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:32.412436 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:32.413228 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:09:32.413717 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG oslo_concurrency.lockutils [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Lock "24af8c6d-20c5-4c42-8aad-3b952e53d778" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:09:32.427165 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.wsgi [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] HTTP exception thrown: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Request method failure captured: May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: request: GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 HTTP/1.1 May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept: application/json May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Accept-Encoding: identity May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Connection: close May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Length: 0 May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Content-Type: application/json May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Host: 10.222.0.49 May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Openstack-System-Scope: None May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: User-Agent: python-urllib3/1.26.9 May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Auth-Token: gAAAAABiflbnY7x2-dQX-sTiLuB20dfyciKoB-f9AllK-_lFbT49iMJ8qR-epMUty9UOMJXZWoSEqc2K5n9jyV8aN6hi_FPHJ3-KttOhSKDb9ojpQI7yXhRweBF58JJYjJY55U39YlT_4FocVtdZUQ1VRy7_0Iiu7bAHOcxvS4Pd593HvZS5P2U May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Id: None May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Domain-Name: None May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Identity-Status: Confirmed May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Is-Admin-Project: True May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Id: default May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Domain-Name: Default May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Project-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Role: reader,member May 13 13:09:32.428673 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Roles: reader,member May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a60c4cb84044c338d954f9a3ec8ef31", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a60c4cb84044c338d954f9a3ec8ef31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Id: 6a60c4cb84044c338d954f9a3ec8ef31 May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-Tenant-Name: tempest-TestVolumeBootPattern-1354158425 May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Id: default May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Domain-Name: Default May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Id: 0956067c32cd476a8db7ee074f210700 May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: X-User-Name: tempest-TestVolumeBootPattern-1354158425-project May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: method: > May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: exception: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.430426 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: action_args: {'id': '949ac2a1-5fa1-458a-954b-09355d5dfc68'} May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: {{(pid=123409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:09:32.431292 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. May 13 13:09:32.432762 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: ERROR nova.api.openstack.wsgi May 13 13:09:32.434161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: DEBUG nova.api.openstack.wsgi [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Returning 404 to user: Instance 949ac2a1-5fa1-458a-954b-09355d5dfc68 could not be found. {{(pid=123409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:09:32.434161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO nova.api.openstack.requestlog [None req-f8b37de4-059f-4590-8bdd-f4fb270312bb tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68" status: 404 len: 111 microversion: 2.1 time: 0.028901 May 13 13:09:32.434161 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: [pid: 123409|app: 0|req: 511/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Fri May 13 13:09:32 2022] GET /compute/v2.1/servers/949ac2a1-5fa1-458a-954b-09355d5dfc68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:09:33.711872 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: DEBUG nova.api.openstack.wsgi [None req-509bd107-7ceb-43ae-b2af-a8bbe5eaafde tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] Calling method '.version_select at 0x7f0601ebb820>' {{(pid=123410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:09:33.736554 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO nova.api.openstack.requestlog [None req-509bd107-7ceb-43ae-b2af-a8bbe5eaafde tempest-TestVolumeBootPattern-1354158425 tempest-TestVolumeBootPattern-1354158425-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1219736643" status: 202 len: 0 microversion: 2.1 time: 0.028431 May 13 13:09:33.737402 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: [pid: 123410|app: 0|req: 539/1050] 10.222.0.49 () {58 vars in 1262 bytes} [Fri May 13 13:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1219736643 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:09:56.122822 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:09:56.123465 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Fri May 13 13:09:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:11:17.048586 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:11:17.049163 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Fri May 13 13:11:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:12:25.759152 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:12:25.759845 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Fri May 13 13:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:12:46.391581 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:12:46.392155 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Fri May 13 13:12:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:13:16.132092 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:13:16.132694 dv-cinder-841644-1-iscsi devstack@n-api.service[123410]: Fri May 13 13:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:14:37.057515 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:14:37.058059 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Fri May 13 13:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:14:39.279550 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:14:39.280179 dv-cinder-841644-1-iscsi devstack@n-api.service[123409]: Fri May 13 13:14:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!